Nov 14 03:26:37 user nova-compute[74836]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74836) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 03:26:37 user nova-compute[74836]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74836) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 03:26:37 user nova-compute[74836]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74836) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 03:26:37 user nova-compute[74836]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 03:26:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:26:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:26:38 user nova-compute[74836]: INFO nova.virt.driver [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 03:26:38 user nova-compute[74836]: INFO nova.compute.provider_config [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Acquiring lock "singleton_lock" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Acquired lock "singleton_lock" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Releasing lock "singleton_lock" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Full set of CONF: {{(pid=74836) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ******************************************************************************** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Configuration options gathered from: {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ================================================================================ {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] allow_resize_to_same_host      = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] arq_binding_timeout            = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] backdoor_port                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] backdoor_socket                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] block_device_allocate_retries  = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] block_device_allocate_retries_interval = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cert                           = self.pem {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute_monitors               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] config_dir                     = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] config_drive_format            = iso9660 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] config_source                  = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] console_host                   = user {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] control_exchange               = nova {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cpu_allocation_ratio           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] daemon                         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] debug                          = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_access_ip_network_name = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_availability_zone      = nova {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_ephemeral_format       = ext4 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_green_pool_size        = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] default_schedule_zone          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] disk_allocation_ratio          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] enable_new_services            = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] enabled_ssl_apis               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] flat_injected                  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] force_config_drive             = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] force_raw_images               = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] graceful_shutdown_timeout      = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] heal_instance_info_cache_interval = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] host                           = user {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_build_timeout         = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_delete_interval       = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_name_template         = instance-%08x {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_usage_audit           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_usage_audit_period    = month {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] internal_service_availability_zone = internal {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] key                            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] live_migration_retry_count     = 30 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_config_append              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_dir                        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_file                       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_options                    = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_rotate_interval            = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_rotate_interval_type       = days {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] log_rotation_type              = none {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] long_rpc_timeout               = 1800 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_concurrent_builds          = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_concurrent_live_migrations = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_concurrent_snapshots       = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_local_block_devices        = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_logfile_count              = 30 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] max_logfile_size_mb            = 200 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] maximum_instance_delete_attempts = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metadata_listen                = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metadata_listen_port           = 8775 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metadata_workers               = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] migrate_max_retries            = -1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] mkisofs_cmd                    = genisoimage {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] my_ip                          = 10.0.0.210 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] network_allocate_retries       = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] osapi_compute_listen_port      = 8774 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] osapi_compute_unique_server_name_scope =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] osapi_compute_workers          = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] password_length                = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] periodic_enable                = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] periodic_fuzzy_delay           = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] pointer_model                  = ps2mouse {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] preallocate_images             = none {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] publish_errors                 = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] pybasedir                      = /opt/stack/nova {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ram_allocation_ratio           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rate_limit_burst               = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rate_limit_except_level        = CRITICAL {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rate_limit_interval            = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reboot_timeout                 = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reclaim_instance_interval      = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] record                         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reimage_timeout_per_gb         = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] report_interval                = 120 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rescue_timeout                 = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reserved_host_cpus             = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reserved_host_disk_mb          = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reserved_host_memory_mb        = 512 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] reserved_huge_pages            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] resize_confirm_window          = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] resize_fs_using_block_device   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] resume_guests_state_on_host_boot = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rpc_response_timeout           = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] run_external_periodic_tasks    = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] running_deleted_instance_action = reap {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] running_deleted_instance_timeout = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler_instance_sync_interval = 120 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_down_time              = 720 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] servicegroup_driver            = db {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] shelved_offload_time           = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] shelved_poll_interval          = 3600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] shutdown_timeout               = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] source_is_ipv6                 = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ssl_only                       = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] state_path                     = /opt/stack/data/nova {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] sync_power_state_interval      = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] sync_power_state_pool_size     = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] syslog_log_facility            = LOG_USER {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] tempdir                        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] timeout_nbd                    = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] transport_url                  = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] update_resources_interval      = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_cow_images                 = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_eventlog                   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_journal                    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_json                       = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_rootwrap_daemon            = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_stderr                     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] use_syslog                     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vcpu_pin_set                   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plugging_is_fatal          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plugging_timeout           = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] virt_mkfs                      = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] volume_usage_poll_interval     = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] watch_log_file                 = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] web                            = /usr/share/spice-html5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_concurrency.disable_process_locking = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.auth_strategy              = keystone {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.compute_link_prefix        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.dhcp_domain                = novalocal {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.enable_instance_password   = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.glance_link_prefix         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.instance_list_per_project_cells = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.list_records_by_skipping_down_cells = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.local_metadata_per_cell    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.max_limit                  = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.metadata_cache_expiration  = 15 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.neutron_default_tenant_id  = default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.use_forwarded_for          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.use_neutron_default_nets   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_dynamic_targets = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_jsonfile_path   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.backend_argument         = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.config_prefix            = cache.oslo {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.dead_timeout             = 60.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.debug_cache_backend      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.enable_retry_client      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.enable_socket_keepalive  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.enabled                  = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.expiration_time          = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.hashclient_retry_attempts = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_dead_retry      = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_password        =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_sasl_enabled    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.memcache_username        =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.proxies                  = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.retry_attempts           = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.retry_delay              = 0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.socket_keepalive_count   = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.socket_keepalive_idle    = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.socket_keepalive_interval = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.tls_allowed_ciphers      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.tls_cafile               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.tls_certfile             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.tls_enabled              = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cache.tls_keyfile              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.auth_section            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.auth_type               = password {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.cafile                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.certfile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.collect_timing          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.cross_az_attach         = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.debug                   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.endpoint_template       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.http_retries            = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.insecure                = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.keyfile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.os_region_name          = RegionOne {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.split_loggers           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cinder.timeout                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.cpu_dedicated_set      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.cpu_shared_set         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.image_type_exclude_list = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.resource_provider_association_refresh = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.shutdown_retry_interval = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] conductor.workers              = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] console.allowed_origins        = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] console.ssl_ciphers            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] console.ssl_minimum_version    = default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] consoleauth.token_ttl          = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.cafile                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.certfile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.collect_timing          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.connect_retries         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.connect_retry_delay     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.endpoint_override       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.insecure                = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.keyfile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.max_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.min_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.region_name             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.service_name            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.service_type            = accelerator {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.split_loggers           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.status_code_retries     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.timeout                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] cyborg.version                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.backend               = sqlalchemy {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.connection            = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.connection_debug      = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.connection_parameters =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.connection_recycle_time = 3600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.connection_trace      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.db_inc_retry_interval = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.db_max_retries        = 20 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.db_max_retry_interval = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.db_retry_interval     = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.max_overflow          = 50 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.max_pool_size         = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.max_retries           = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.mysql_wsrep_sync_wait = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.pool_timeout          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.retry_interval        = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.slave_connection      = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] database.sqlite_synchronous    = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.backend           = sqlalchemy {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.connection        = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.connection_debug  = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.connection_parameters =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.connection_recycle_time = 3600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.connection_trace  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.db_inc_retry_interval = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.db_max_retries    = 20 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.db_max_retry_interval = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.db_retry_interval = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.max_overflow      = 50 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.max_pool_size     = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.max_retries       = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.pool_timeout      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.retry_interval    = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.slave_connection  = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] api_database.sqlite_synchronous = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] devices.enabled_mdev_types     = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ephemeral_storage_encryption.enabled = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.api_servers             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.cafile                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.certfile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.collect_timing          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.connect_retries         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.connect_retry_delay     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.debug                   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.default_trusted_certificate_ids = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.enable_certificate_validation = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.enable_rbd_download     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.endpoint_override       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.insecure                = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.keyfile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.max_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.min_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.num_retries             = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.rbd_ceph_conf           =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.rbd_connect_timeout     = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.rbd_pool                =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.rbd_user                =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.region_name             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.service_name            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.service_type            = image {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.split_loggers           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.status_code_retries     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.timeout                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.verify_glance_signatures = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] glance.version                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] guestfs.debug                  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.config_drive_cdrom      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.config_drive_inject_password = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.enable_remotefx         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.instances_path_share    =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.limit_cpu_features      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.use_multipath_io        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.vswitch_name            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] mks.enabled                    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.manager_interval   = 2400 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.precache_concurrency = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.remove_unused_base_images = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] image_cache.subdirectory_name  = _base {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.api_max_retries         = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.api_retry_interval      = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.auth_section            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.auth_type               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.cafile                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.certfile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.collect_timing          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.conductor_group         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.connect_retries         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.connect_retry_delay     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.endpoint_override       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.insecure                = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.keyfile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.max_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.min_version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.peer_list               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.region_name             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.serial_console_state_timeout = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.service_name            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.service_type            = baremetal {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.split_loggers           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.status_code_retries     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.timeout                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ironic.version                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] key_manager.fixed_key          = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.barbican_api_version  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.barbican_endpoint     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.barbican_endpoint_type = public {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.barbican_region_name  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.cafile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.certfile              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.collect_timing        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.insecure              = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.keyfile               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.number_of_retries     = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.retry_delay           = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.send_service_user_token = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.split_loggers         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.timeout               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.verify_ssl            = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican.verify_ssl_path       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.auth_section = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.auth_type = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.cafile   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.certfile = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.collect_timing = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.insecure = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.keyfile  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.split_loggers = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] barbican_service_user.timeout  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.approle_role_id          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.approle_secret_id        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.cafile                   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.certfile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.collect_timing           = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.insecure                 = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.keyfile                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.kv_mountpoint            = secret {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.kv_path                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.kv_version               = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.namespace                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.root_token_id            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.split_loggers            = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.ssl_ca_crt_file          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.timeout                  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.use_ssl                  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.auth_section          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.auth_type             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.cafile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.certfile              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.collect_timing        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.connect_retries       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.connect_retry_delay   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.endpoint_override     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.insecure              = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.keyfile               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.max_version           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.min_version           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.region_name           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.service_name          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.service_type          = identity {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.split_loggers         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.status_code_retries   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.timeout               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] keystone.version               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.connection_uri         =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_mode               = custom {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: WARNING oslo_config.cfg [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_power_governor_high = performance {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_power_management   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.device_detach_attempts = 8 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.device_detach_timeout  = 20 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.disk_cachemodes        = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.disk_prefix            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.enabled_perf_events    = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.file_backed_memory     = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.gid_maps               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.hw_disk_discard        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.hw_machine_type        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_rbd_pool        = rbd {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_type            = default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.images_volume_group    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.inject_key             = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.inject_partition       = -2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.inject_password        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.iscsi_iface            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.iser_use_multipath     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_downtime = 500 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_inbound_addr = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_scheme  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_timeout_action = abort {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_tunnelled = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: WARNING oslo_config.cfg [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 03:26:38 user nova-compute[74836]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 03:26:38 user nova-compute[74836]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 03:26:38 user nova-compute[74836]: and ``live_migration_inbound_addr`` respectively.
Nov 14 03:26:38 user nova-compute[74836]: ).  Its value may be silently ignored in the future.
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.live_migration_with_native_tls = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.max_queues             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.nfs_mount_options      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_pcie_ports         = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.pmem_namespaces        = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.quobyte_client_cfg     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rbd_secret_uuid        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rbd_user               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rescue_image_id        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rescue_kernel_id       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.rx_queue_size          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.smbfs_mount_options    =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.snapshot_compression   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.snapshot_image_format  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.sparse_logical_volumes = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.swtpm_enabled          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.swtpm_group            = tss {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.swtpm_user             = tss {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.sysinfo_serial         = unique {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.tb_cache_size          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.tx_queue_size          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.uid_maps               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.use_virtio_for_bridges = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.virt_type              = kvm {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.volume_clear           = zero {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.volume_clear_size      = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.volume_use_multipath   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_cache_path   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.auth_section           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.auth_type              = password {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.cafile                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.certfile               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.collect_timing         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.connect_retries        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.connect_retry_delay    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.default_floating_pool  = public {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.endpoint_override      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.extension_sync_interval = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.http_retries           = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.insecure               = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.keyfile                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.max_version            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.min_version            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.ovs_bridge             = br-int {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.physnets               = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.region_name            = RegionOne {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.service_metadata_proxy = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.service_name           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.service_type           = network {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.split_loggers          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.status_code_retries    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.timeout                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] neutron.version                = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] notifications.bdms_in_notifications = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] notifications.default_level    = INFO {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] notifications.notification_format = unversioned {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] notifications.notify_on_state_change = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] pci.alias                      = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] pci.device_spec                = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] pci.report_in_placement        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.auth_section         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.auth_type            = password {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.cafile               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.certfile             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.collect_timing       = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.connect_retries      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.connect_retry_delay  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.default_domain_id    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.default_domain_name  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.domain_id            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.domain_name          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.endpoint_override    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.insecure             = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.keyfile              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.max_version          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.min_version          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.password             = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.project_domain_id    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.project_domain_name  = Default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.project_id           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.project_name         = service {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.region_name          = RegionOne {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.service_name         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.service_type         = placement {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.split_loggers        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.status_code_retries  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.system_scope         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.timeout              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.trust_id             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.user_domain_id       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.user_domain_name     = Default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.user_id              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.username             = placement {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] placement.version              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.cores                    = 20 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.count_usage_from_placement = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.injected_file_content_bytes = 10240 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.injected_file_path_length = 255 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.injected_files           = 5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.instances                = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.key_pairs                = 100 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.metadata_items           = 128 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.ram                      = 51200 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.recheck_quota            = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.server_group_members     = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] quota.server_groups            = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rdp.enabled                    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.image_metadata_prefilter = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.max_attempts         = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.max_placement_results = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] scheduler.workers              = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.host_subset_size = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.isolated_hosts = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.isolated_images = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.pci_in_placement = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.track_instance_changes = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metrics.required               = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metrics.weight_multiplier      = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] metrics.weight_setting         = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.enabled         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.port_range      = 10000:20000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] serial_console.serialproxy_port = 6083 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.auth_section      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.auth_type         = password {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.cafile            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.certfile          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.collect_timing    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.insecure          = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.keyfile           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.send_service_user_token = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.split_loggers     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] service_user.timeout           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.agent_enabled            = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.enabled                  = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.html5proxy_port          = 6082 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.image_compression        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.jpeg_compression         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.playback_compression     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.server_listen            = 127.0.0.1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.streaming_mode           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] spice.zlib_compression         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] upgrade_levels.baseapi         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] upgrade_levels.cert            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] upgrade_levels.compute         = auto {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] upgrade_levels.conductor       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] upgrade_levels.scheduler       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.cafile = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.certfile = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.insecure = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vendordata_dynamic_auth.timeout = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.api_retry_count         = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.ca_file                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.cache_prefix            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.cluster_name            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.connection_pool_size    = 10 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.console_delay_seconds   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.datastore_regex         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.host_ip                 = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.host_password           = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.host_port               = 443 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.host_username           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.insecure                = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.integration_bridge      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.maximum_objects         = 100 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.pbm_default_policy      = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.pbm_enabled             = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.pbm_wsdl_location       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.serial_port_proxy_uri   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.serial_port_service_uri = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.task_poll_interval      = 0.5 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.use_linked_clone        = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.vnc_keymap              = en-us {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.vnc_port                = 5900 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vmware.vnc_port_total          = 10000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.auth_schemes               = ['none'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.enabled                    = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.novncproxy_port            = 6080 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.vencrypt_ca_certs          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.vencrypt_client_cert       = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vnc.vencrypt_client_key        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.disable_rootwrap   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.enable_numa_live_migration = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.libvirt_disable_apic = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.client_socket_timeout     = 900 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.default_pool_size         = 1000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.keep_alive                = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.max_header_line           = 16384 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.ssl_ca_file               = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.ssl_cert_file             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.ssl_key_file              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.tcp_keepidle              = 600 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] zvm.ca_file                    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] zvm.cloud_connector_url        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] zvm.reachable_timeout          = 300 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.enforce_new_defaults = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.enforce_scope      = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.policy_default_rule = default {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.connection_string     = messaging:// {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.enabled               = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.es_doc_type           = notification {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.es_scroll_size        = 10000 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.es_scroll_time        = 2m {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.filter_error_trace    = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.hmac_keys             = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.sentinel_service_name = mymaster {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.socket_timeout        = 0.1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.trace_requests        = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler.trace_sqlalchemy      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler_jaeger.process_tags   = {} {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler_jaeger.service_name_prefix = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] profiler_otlp.service_name_prefix = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] remote_debug.host              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] remote_debug.port              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_notifications.retry = -1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.auth_section        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.auth_type           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.cafile              = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.certfile            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.collect_timing      = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.connect_retries     = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.connect_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.endpoint_id         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.endpoint_override   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.insecure            = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.keyfile             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.max_version         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.min_version         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.region_name         = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.service_name        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.service_type        = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.split_loggers       = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.status_code_retries = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.status_code_retry_delay = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.timeout             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.valid_interfaces    = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_limit.version             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_reports.file_event_handler = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] oslo_reports.log_dir           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.group  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] vif_plug_ovs_privileged.user   = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.isolate_vif         = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] os_brick.lock_path             = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.capabilities   = [21] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.group          = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.helper_command = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] privsep_osbrick.user           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.group           = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.helper_command  = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] nova_sys_admin.user            = None {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG oslo_service.service [None req-23a7338d-44fa-4562-b94a-a6296025b3f3 None None] ******************************************************************************** {{(pid=74836) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 03:26:38 user nova-compute[74836]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Connecting to libvirt: qemu:///system {{(pid=74836) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f29e609f010> {{(pid=74836) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 03:26:38 user nova-compute[74836]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 03:26:38 user nova-compute[74836]: WARNING nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f29e609f010> {{(pid=74836) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Starting native event thread {{(pid=74836) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Starting green dispatch thread {{(pid=74836) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Starting connection event dispatch thread {{(pid=74836) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 03:26:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Connection event '1' reason 'None'
Nov 14 03:26:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 03:26:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.mount [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Initialising _HostMountState generation 0 {{(pid=74836) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 03:26:45 user nova-compute[74836]: INFO nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host capabilities <capabilities>
Nov 14 03:26:45 user nova-compute[74836]:   <host>
Nov 14 03:26:45 user nova-compute[74836]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 03:26:45 user nova-compute[74836]:     <cpu>
Nov 14 03:26:45 user nova-compute[74836]:       <arch>x86_64</arch>
Nov 14 03:26:45 user nova-compute[74836]:       <model>IvyBridge-IBRS</model>
Nov 14 03:26:45 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:45 user nova-compute[74836]:       <microcode version='1070'/>
Nov 14 03:26:45 user nova-compute[74836]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 03:26:45 user nova-compute[74836]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='ss'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='vmx'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='pcid'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='osxsave'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='hypervisor'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='arat'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='tsc_adjust'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='md-clear'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='stibp'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='arch-capabilities'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='ssbd'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='invtsc'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='rsba'/>
Nov 14 03:26:45 user nova-compute[74836]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 03:26:45 user nova-compute[74836]:       <pages unit='KiB' size='4'/>
Nov 14 03:26:45 user nova-compute[74836]:       <pages unit='KiB' size='2048'/>
Nov 14 03:26:45 user nova-compute[74836]:     </cpu>
Nov 14 03:26:45 user nova-compute[74836]:     <power_management>
Nov 14 03:26:45 user nova-compute[74836]:       <suspend_mem/>
Nov 14 03:26:45 user nova-compute[74836]:       <suspend_disk/>
Nov 14 03:26:45 user nova-compute[74836]:       <suspend_hybrid/>
Nov 14 03:26:45 user nova-compute[74836]:     </power_management>
Nov 14 03:26:45 user nova-compute[74836]:     <iommu support='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     <migration_features>
Nov 14 03:26:45 user nova-compute[74836]:       <live/>
Nov 14 03:26:45 user nova-compute[74836]:       <uri_transports>
Nov 14 03:26:45 user nova-compute[74836]:         <uri_transport>tcp</uri_transport>
Nov 14 03:26:45 user nova-compute[74836]:         <uri_transport>rdma</uri_transport>
Nov 14 03:26:45 user nova-compute[74836]:       </uri_transports>
Nov 14 03:26:45 user nova-compute[74836]:     </migration_features>
Nov 14 03:26:45 user nova-compute[74836]:     <topology>
Nov 14 03:26:45 user nova-compute[74836]:       <cells num='2'>
Nov 14 03:26:45 user nova-compute[74836]:         <cell id='0'>
Nov 14 03:26:45 user nova-compute[74836]:           <memory unit='KiB'>8189224</memory>
Nov 14 03:26:45 user nova-compute[74836]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 03:26:45 user nova-compute[74836]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 03:26:45 user nova-compute[74836]:           <distances>
Nov 14 03:26:45 user nova-compute[74836]:             <sibling id='0' value='10'/>
Nov 14 03:26:45 user nova-compute[74836]:             <sibling id='1' value='20'/>
Nov 14 03:26:45 user nova-compute[74836]:           </distances>
Nov 14 03:26:45 user nova-compute[74836]:           <cpus num='6'>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 03:26:45 user nova-compute[74836]:           </cpus>
Nov 14 03:26:45 user nova-compute[74836]:         </cell>
Nov 14 03:26:45 user nova-compute[74836]:         <cell id='1'>
Nov 14 03:26:45 user nova-compute[74836]:           <memory unit='KiB'>8206460</memory>
Nov 14 03:26:45 user nova-compute[74836]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 03:26:45 user nova-compute[74836]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 03:26:45 user nova-compute[74836]:           <distances>
Nov 14 03:26:45 user nova-compute[74836]:             <sibling id='0' value='20'/>
Nov 14 03:26:45 user nova-compute[74836]:             <sibling id='1' value='10'/>
Nov 14 03:26:45 user nova-compute[74836]:           </distances>
Nov 14 03:26:45 user nova-compute[74836]:           <cpus num='6'>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 03:26:45 user nova-compute[74836]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 03:26:45 user nova-compute[74836]:           </cpus>
Nov 14 03:26:45 user nova-compute[74836]:         </cell>
Nov 14 03:26:45 user nova-compute[74836]:       </cells>
Nov 14 03:26:45 user nova-compute[74836]:     </topology>
Nov 14 03:26:45 user nova-compute[74836]:     <cache>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 03:26:45 user nova-compute[74836]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 03:26:45 user nova-compute[74836]:     </cache>
Nov 14 03:26:45 user nova-compute[74836]:     <secmodel>
Nov 14 03:26:45 user nova-compute[74836]:       <model>apparmor</model>
Nov 14 03:26:45 user nova-compute[74836]:       <doi>0</doi>
Nov 14 03:26:45 user nova-compute[74836]:     </secmodel>
Nov 14 03:26:45 user nova-compute[74836]:     <secmodel>
Nov 14 03:26:45 user nova-compute[74836]:       <model>dac</model>
Nov 14 03:26:45 user nova-compute[74836]:       <doi>0</doi>
Nov 14 03:26:45 user nova-compute[74836]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 03:26:45 user nova-compute[74836]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 03:26:45 user nova-compute[74836]:     </secmodel>
Nov 14 03:26:45 user nova-compute[74836]:   </host>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='alpha'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>clipper</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='armv6l'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>spitz</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>nuri</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>kzm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>z2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>tosa</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n810</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>terrier</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>midway</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>microbit</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>verdex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>highbank</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>akita</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>connex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>collie</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='armv7l'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>spitz</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>nuri</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>kzm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>z2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>tosa</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n810</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>terrier</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>midway</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>microbit</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>verdex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>highbank</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>akita</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>connex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>collie</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='aarch64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>spitz</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>nuri</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>kzm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>z2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>tosa</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n810</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>n800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>terrier</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>midway</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>microbit</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>verdex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>highbank</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>akita</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>connex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>collie</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <acpi default='on' toggle='yes'/>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='cris'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='i686'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>isapc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>microvm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='kvm'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <pae/>
Nov 14 03:26:45 user nova-compute[74836]:       <nonpae/>
Nov 14 03:26:45 user nova-compute[74836]:       <acpi default='on' toggle='yes'/>
Nov 14 03:26:45 user nova-compute[74836]:       <apic default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='m68k'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>an5206</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>q800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='microblaze'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='microblazeel'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='mips'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>malta</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='mipsel'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>malta</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='mips64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>malta</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>pica61</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>magnum</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='mips64el'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>malta</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>pica61</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>magnum</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='16'>boston</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='ppc'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mac99</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>40p</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>taihu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='ppc64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>taihu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>40p</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mac99</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='ppc64le'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>taihu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>40p</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>mac99</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='riscv32'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='8'>spike</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='8'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='riscv64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='8'>spike</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='8'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='s390x'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='sh4'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>shix</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>r2d</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='sh4eb'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>shix</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>r2d</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='sparc'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>LX</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='sparc64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>niagara</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='x86_64'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>64</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='1'>isapc</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>microvm</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='kvm'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <acpi default='on' toggle='yes'/>
Nov 14 03:26:45 user nova-compute[74836]:       <apic default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='xtensa'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>sim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>kc705</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ml605</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx200</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx60</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]:   <guest>
Nov 14 03:26:45 user nova-compute[74836]:     <os_type>hvm</os_type>
Nov 14 03:26:45 user nova-compute[74836]:     <arch name='xtensaeb'>
Nov 14 03:26:45 user nova-compute[74836]:       <wordsize>32</wordsize>
Nov 14 03:26:45 user nova-compute[74836]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='4'>sim</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>kc705</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ml605</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>virt</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx200</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>lx60</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 03:26:45 user nova-compute[74836]:       <domain type='qemu'/>
Nov 14 03:26:45 user nova-compute[74836]:     </arch>
Nov 14 03:26:45 user nova-compute[74836]:     <features>
Nov 14 03:26:45 user nova-compute[74836]:       <cpuselection/>
Nov 14 03:26:45 user nova-compute[74836]:       <deviceboot/>
Nov 14 03:26:45 user nova-compute[74836]:       <disksnapshot default='on' toggle='no'/>
Nov 14 03:26:45 user nova-compute[74836]:     </features>
Nov 14 03:26:45 user nova-compute[74836]:   </guest>
Nov 14 03:26:45 user nova-compute[74836]: </capabilities>
Nov 14 03:26:45 user nova-compute[74836]: 
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-i440fx-6.2</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>i686</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='255'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'/>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='lm'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ide</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-q35-6.2</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>i686</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='288'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'/>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='lm'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-q35-jammy</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>i686</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='288'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'/>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='lm'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-i440fx-jammy</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>i686</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='255'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'/>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='lm'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ide</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-i440fx-6.2</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>x86_64</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='255'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>efi</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='invtsc'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='rsba'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ide</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-q35-6.2</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>x86_64</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='288'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>efi</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='invtsc'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='rsba'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-q35-jammy</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>x86_64</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='288'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>efi</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='invtsc'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='rsba'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 03:26:46 user nova-compute[74836]: <domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 03:26:46 user nova-compute[74836]:   <domain>kvm</domain>
Nov 14 03:26:46 user nova-compute[74836]:   <machine>pc-i440fx-jammy</machine>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>x86_64</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <vcpu max='255'/>
Nov 14 03:26:46 user nova-compute[74836]:   <iothreads supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:   <os supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='firmware'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>efi</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:     <loader supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>rom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pflash</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='readonly'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>yes</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='secure'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>no</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </loader>
Nov 14 03:26:46 user nova-compute[74836]:   </os>
Nov 14 03:26:46 user nova-compute[74836]:   <cpu>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-passthrough' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='hostPassthroughMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='maximum' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='maximumMigratable'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>on</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>off</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='host-model' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ss'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='vmx'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pcid'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='hypervisor'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arat'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='umip'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='md-clear'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='invtsc'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibpb'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='ibrs'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-stibp'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='rsba'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='erms'/>
Nov 14 03:26:46 user nova-compute[74836]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:     <mode name='custom' supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>qemu64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>qemu32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>phenom</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>pentium</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>n270</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm64</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>kvm32</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>coreduo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>core2duo</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>athlon</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Westmere</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Snowridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Skylake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>SandyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Penryn</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G5</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G4</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G3</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Opteron_G2</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Opteron_G1</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>IvyBridge</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Icelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Haswell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Rome</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-Milan</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>EPYC</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Dhyana</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cooperlake</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>Conroe</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='no'>Broadwell</model>
Nov 14 03:26:46 user nova-compute[74836]:       <model usable='yes'>486</model>
Nov 14 03:26:46 user nova-compute[74836]:     </mode>
Nov 14 03:26:46 user nova-compute[74836]:   </cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <memoryBacking supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:     <enum name='sourceType'>
Nov 14 03:26:46 user nova-compute[74836]:       <value>file</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>anonymous</value>
Nov 14 03:26:46 user nova-compute[74836]:       <value>memfd</value>
Nov 14 03:26:46 user nova-compute[74836]:     </enum>
Nov 14 03:26:46 user nova-compute[74836]:   </memoryBacking>
Nov 14 03:26:46 user nova-compute[74836]:   <devices>
Nov 14 03:26:46 user nova-compute[74836]:     <disk supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='diskDevice'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>disk</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cdrom</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>floppy</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>lun</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='bus'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ide</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>fdc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sata</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </disk>
Nov 14 03:26:46 user nova-compute[74836]:     <graphics supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='type'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>sdl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vnc</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>spice</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egl-headless</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </graphics>
Nov 14 03:26:46 user nova-compute[74836]:     <video supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='modelType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>cirrus</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>vmvga</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>qxl</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>none</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>bochs</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>ramfb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </video>
Nov 14 03:26:46 user nova-compute[74836]:     <hostdev supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='mode'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>subsystem</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='startupPolicy'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>default</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>mandatory</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>requisite</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>optional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='subsysType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>usb</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>pci</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>scsi</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='capsType'/>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='pciBackend'/>
Nov 14 03:26:46 user nova-compute[74836]:     </hostdev>
Nov 14 03:26:46 user nova-compute[74836]:     <rng supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtio-non-transitional</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>random</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>egd</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>builtin</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </rng>
Nov 14 03:26:46 user nova-compute[74836]:     <filesystem supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='driverType'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>path</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>handle</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>virtiofs</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </filesystem>
Nov 14 03:26:46 user nova-compute[74836]:     <tpm supported='yes'>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='model'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-tis</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>tpm-crb</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:       <enum name='backendModel'>
Nov 14 03:26:46 user nova-compute[74836]:         <value>passthrough</value>
Nov 14 03:26:46 user nova-compute[74836]:         <value>emulator</value>
Nov 14 03:26:46 user nova-compute[74836]:       </enum>
Nov 14 03:26:46 user nova-compute[74836]:     </tpm>
Nov 14 03:26:46 user nova-compute[74836]:   </devices>
Nov 14 03:26:46 user nova-compute[74836]:   <features>
Nov 14 03:26:46 user nova-compute[74836]:     <gic supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:     <vmcoreinfo supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <genid supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backingStoreInput supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <backup supported='yes'/>
Nov 14 03:26:46 user nova-compute[74836]:     <sev supported='no'/>
Nov 14 03:26:46 user nova-compute[74836]:   </features>
Nov 14 03:26:46 user nova-compute[74836]: </domainCapabilities>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74836) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74836) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Checking secure boot support for host arch (x86_64) {{(pid=74836) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Checking secure boot support for host arch (x86_64) {{(pid=74836) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Checking secure boot support for host arch (x86_64) {{(pid=74836) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Secure Boot support detected
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] cpu compare xml: <cpu match="exact">
Nov 14 03:26:46 user nova-compute[74836]:   <model>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]: </cpu>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.virt.node [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Generated node identity 9f482475-a4db-44a1-b0c2-dcf4a6aba2de
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.virt.node [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Wrote node identity 9f482475-a4db-44a1-b0c2-dcf4a6aba2de to /opt/stack/data/nova/compute_id
Nov 14 03:26:46 user nova-compute[74836]: WARNING nova.compute.manager [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Compute nodes ['9f482475-a4db-44a1-b0c2-dcf4a6aba2de'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.compute.manager [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 03:26:46 user nova-compute[74836]: WARNING nova.compute.manager [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 03:26:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:26:46 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:26:46 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Hypervisor/Node resource view: name=user free_ram=10974MB free_disk=26.130577087402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:26:46 user nova-compute[74836]: WARNING nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] No compute node record for user:9f482475-a4db-44a1-b0c2-dcf4a6aba2de: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 9f482475-a4db-44a1-b0c2-dcf4a6aba2de could not be found.
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Compute node record created for user:user with uuid: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] [req-5a715c1e-5ba9-4726-b199-6b1e05887838] Created resource provider record via placement API for resource provider with UUID 9f482475-a4db-44a1-b0c2-dcf4a6aba2de and name user.
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74836) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 03:26:46 user nova-compute[74836]: INFO nova.virt.libvirt.host [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] kernel doesn't support AMD SEV
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Libvirt baseline CPU <cpu>
Nov 14 03:26:46 user nova-compute[74836]:   <arch>x86_64</arch>
Nov 14 03:26:46 user nova-compute[74836]:   <model>Nehalem</model>
Nov 14 03:26:46 user nova-compute[74836]:   <vendor>Intel</vendor>
Nov 14 03:26:46 user nova-compute[74836]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 03:26:46 user nova-compute[74836]: </cpu>
Nov 14 03:26:46 user nova-compute[74836]:  {{(pid=74836) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Updated inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Updating resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de generation from 0 to 1 during operation: update_inventory {{(pid=74836) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 03:26:46 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Updating resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de generation from 1 to 2 during operation: update_traits {{(pid=74836) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.675s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG nova.service [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Creating RPC server for service compute {{(pid=74836) start /opt/stack/nova/nova/service.py:182}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG nova.service [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] Join ServiceGroup membership for this service compute {{(pid=74836) start /opt/stack/nova/nova/service.py:199}}
Nov 14 03:26:47 user nova-compute[74836]: DEBUG nova.servicegroup.drivers.db [None req-c92da2fa-ed50-49f2-84cd-869eccae207d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74836) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 03:27:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:27:37 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:27:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:27:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=10391MB free_disk=26.034408569335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:27:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:28:39 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:28:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:28:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=10346MB free_disk=26.08444595336914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:28:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:29:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:29:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:29:41 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:29:42 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:29:42 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=25.851119995117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:29:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:30:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:30:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:30:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:41 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:30:42 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:42 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9624MB free_disk=25.870403289794922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:42 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d has allocations against this compute host but is not found in the database.
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:30:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:30:43 user nova-compute[74836]: INFO nova.compute.claims [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Claim successful on node user
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:30:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:30:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:30:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:30:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Creating image(s)
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.policy [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c470afaa49c481cbf37c789908133d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa969498730e4839bbd15d990c31977d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.part --force-share --output=json" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.virt.images [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] 430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.part /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.part /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.converted" returned: 0 in 0.292s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:44 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:30:44 user nova-compute[74836]: INFO nova.compute.claims [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Claim successful on node user
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.049s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:45 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpixls3f0q/privsep.sock']
Nov 14 03:30:45 user sudo[84089]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpixls3f0q/privsep.sock
Nov 14 03:30:45 user sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:30:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.policy [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7107bdffb0544dd890311071f04662ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353de76529e464c82aa0d303b797362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:30:45 user nova-compute[74836]: INFO nova.compute.claims [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Claim successful on node user
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:30:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Creating image(s)
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:30:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:30:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:30:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Creating image(s)
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Successfully created port: 86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.policy [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c470afaa49c481cbf37c789908133d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa969498730e4839bbd15d990c31977d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:30:46 user sudo[84089]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:46 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Spawned new privsep daemon via rootwrap
Nov 14 03:30:46 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 03:30:46 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 03:30:46 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 03:30:46 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84093
Nov 14 03:30:46 user nova-compute[74836]: WARNING oslo_privsep.priv_context [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] privsep daemon already running
Nov 14 03:30:46 user nova-compute[74836]: WARNING oslo_privsep.priv_context [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] privsep daemon already running
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:30:46 user nova-compute[74836]: INFO nova.compute.claims [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Claim successful on node user
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Successfully created port: fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk 1073741824" returned: 0 in 0.047s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.policy [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab86e22169934541aaf5599c215eb601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300a5c30444b4f93be44cc7580991dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:30:47 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Creating image(s)
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "/opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "/opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk 1073741824" returned: 0 in 0.066s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.471s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Cannot resize image /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Ensure instance console log exists: /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.150s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk 1073741824" returned: 0 in 0.043s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.132s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Cannot resize image /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Ensure instance console log exists: /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.161s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk 1073741824" returned: 0 in 0.043s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Cannot resize image /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Ensure instance console log exists: /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.157s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Successfully updated port: 86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Cannot resize image /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Ensure instance console log exists: /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Successfully created port: 6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-changed-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Refreshing instance network info cache due to event network-changed-86d1e467-9870-48ab-9291-033f4f673003. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:30:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Successfully updated port: fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Successfully created port: 8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance network_info: |[{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.neutron [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Refreshing network info cache for port 86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start _get_guest_xml network_info=[{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:30:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-281568390',display_name='tempest-ServerRescueNegativeTestJSON-server-281568390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-281568390',id=1,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-6ln573ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:44Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=07ea4caa-d030-4ca6-b716-49d37a2d7a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:30:50 user nova-compute[74836]:   <uuid>07ea4caa-d030-4ca6-b716-49d37a2d7a0d</uuid>
Nov 14 03:30:50 user nova-compute[74836]:   <name>instance-00000001</name>
Nov 14 03:30:50 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:30:50 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:30:50 user nova-compute[74836]:   <metadata>
Nov 14 03:30:50 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:30:50 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-281568390</nova:name>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:30:49</nova:creationTime>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:30:50 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:30:50 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:owner>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:30:50 user nova-compute[74836]:       </nova:owner>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:30:50 user nova-compute[74836]:       <nova:ports>
Nov 14 03:30:50 user nova-compute[74836]:         <nova:port uuid="86d1e467-9870-48ab-9291-033f4f673003">
Nov 14 03:30:50 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:30:50 user nova-compute[74836]:         </nova:port>
Nov 14 03:30:50 user nova-compute[74836]:       </nova:ports>
Nov 14 03:30:50 user nova-compute[74836]:     </nova:instance>
Nov 14 03:30:50 user nova-compute[74836]:   </metadata>
Nov 14 03:30:50 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:30:50 user nova-compute[74836]:     <system>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="serial">07ea4caa-d030-4ca6-b716-49d37a2d7a0d</entry>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="uuid">07ea4caa-d030-4ca6-b716-49d37a2d7a0d</entry>
Nov 14 03:30:50 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:30:50 user nova-compute[74836]:     </system>
Nov 14 03:30:50 user nova-compute[74836]:   </sysinfo>
Nov 14 03:30:50 user nova-compute[74836]:   <os>
Nov 14 03:30:50 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:30:50 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:30:50 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:30:50 user nova-compute[74836]:   </os>
Nov 14 03:30:50 user nova-compute[74836]:   <features>
Nov 14 03:30:50 user nova-compute[74836]:     <acpi/>
Nov 14 03:30:50 user nova-compute[74836]:     <apic/>
Nov 14 03:30:50 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:30:50 user nova-compute[74836]:   </features>
Nov 14 03:30:50 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:30:50 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:30:50 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:30:50 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:30:50 user nova-compute[74836]:   </clock>
Nov 14 03:30:50 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:30:50 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:30:50 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:30:50 user nova-compute[74836]:   </cpu>
Nov 14 03:30:50 user nova-compute[74836]:   <devices>
Nov 14 03:30:50 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:30:50 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:30:50 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk"/>
Nov 14 03:30:50 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:30:50 user nova-compute[74836]:     </disk>
Nov 14 03:30:50 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:30:50 user nova-compute[74836]:       <mac address="fa:16:3e:01:ce:e3"/>
Nov 14 03:30:50 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:50 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:30:50 user nova-compute[74836]:       <target dev="tap86d1e467-98"/>
Nov 14 03:30:50 user nova-compute[74836]:     </interface>
Nov 14 03:30:50 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:30:50 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/console.log" append="off"/>
Nov 14 03:30:50 user nova-compute[74836]:     </serial>
Nov 14 03:30:50 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:30:50 user nova-compute[74836]:     <video>
Nov 14 03:30:50 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:50 user nova-compute[74836]:     </video>
Nov 14 03:30:50 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:30:50 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:30:50 user nova-compute[74836]:     </rng>
Nov 14 03:30:50 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:30:50 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:30:50 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:30:50 user nova-compute[74836]:     </memballoon>
Nov 14 03:30:50 user nova-compute[74836]:   </devices>
Nov 14 03:30:50 user nova-compute[74836]: </domain>
Nov 14 03:30:50 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-281568390',display_name='tempest-ServerRescueNegativeTestJSON-server-281568390',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-281568390',id=1,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-6ln573ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:44Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=07ea4caa-d030-4ca6-b716-49d37a2d7a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG os_vif [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Created schema index Interface.name {{(pid=74836) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Created schema index Port.name {{(pid=74836) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Created schema index Bridge.name {{(pid=74836) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [POLLOUT] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b12cd83c-b3b5-5e1c-8d3f-f25b53e65265', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:50 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp9cdkgs9b/privsep.sock']
Nov 14 03:30:50 user sudo[84163]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp9cdkgs9b/privsep.sock
Nov 14 03:30:50 user sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Successfully updated port: 6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-changed-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Refreshing instance network info cache due to event network-changed-fcae15f9-d363-4ad3-a487-ec483dea50ba. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] Acquiring lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-changed-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Refreshing instance network info cache due to event network-changed-6561cb21-a719-4b80-b0fc-1c6d2e2de49a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:30:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] Acquiring lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance network_info: |[{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] Acquired lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Refreshing network info cache for port 6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start _get_guest_xml network_info=[{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:30:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-424831790',display_name='tempest-ServerRescueNegativeTestJSON-server-424831790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-424831790',id=3,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-2030xd1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:46Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=2a266da1-3823-4ae8-b45c-17c1b7543a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:30:51 user nova-compute[74836]:   <uuid>2a266da1-3823-4ae8-b45c-17c1b7543a5a</uuid>
Nov 14 03:30:51 user nova-compute[74836]:   <name>instance-00000003</name>
Nov 14 03:30:51 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:30:51 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:30:51 user nova-compute[74836]:   <metadata>
Nov 14 03:30:51 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:30:51 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-424831790</nova:name>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:30:51</nova:creationTime>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:30:51 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:owner>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:owner>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:ports>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:port uuid="6561cb21-a719-4b80-b0fc-1c6d2e2de49a">
Nov 14 03:30:51 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 03:30:51 user nova-compute[74836]:         </nova:port>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:ports>
Nov 14 03:30:51 user nova-compute[74836]:     </nova:instance>
Nov 14 03:30:51 user nova-compute[74836]:   </metadata>
Nov 14 03:30:51 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:30:51 user nova-compute[74836]:     <system>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="serial">2a266da1-3823-4ae8-b45c-17c1b7543a5a</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="uuid">2a266da1-3823-4ae8-b45c-17c1b7543a5a</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:30:51 user nova-compute[74836]:     </system>
Nov 14 03:30:51 user nova-compute[74836]:   </sysinfo>
Nov 14 03:30:51 user nova-compute[74836]:   <os>
Nov 14 03:30:51 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:30:51 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:30:51 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:30:51 user nova-compute[74836]:   </os>
Nov 14 03:30:51 user nova-compute[74836]:   <features>
Nov 14 03:30:51 user nova-compute[74836]:     <acpi/>
Nov 14 03:30:51 user nova-compute[74836]:     <apic/>
Nov 14 03:30:51 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:30:51 user nova-compute[74836]:   </features>
Nov 14 03:30:51 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:30:51 user nova-compute[74836]:   </clock>
Nov 14 03:30:51 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:30:51 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:30:51 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:30:51 user nova-compute[74836]:   </cpu>
Nov 14 03:30:51 user nova-compute[74836]:   <devices>
Nov 14 03:30:51 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:30:51 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:30:51 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk"/>
Nov 14 03:30:51 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:     </disk>
Nov 14 03:30:51 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:30:51 user nova-compute[74836]:       <mac address="fa:16:3e:48:37:d9"/>
Nov 14 03:30:51 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:30:51 user nova-compute[74836]:       <target dev="tap6561cb21-a7"/>
Nov 14 03:30:51 user nova-compute[74836]:     </interface>
Nov 14 03:30:51 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:30:51 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/console.log" append="off"/>
Nov 14 03:30:51 user nova-compute[74836]:     </serial>
Nov 14 03:30:51 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:30:51 user nova-compute[74836]:     <video>
Nov 14 03:30:51 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:     </video>
Nov 14 03:30:51 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:30:51 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:30:51 user nova-compute[74836]:     </rng>
Nov 14 03:30:51 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:30:51 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:30:51 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:30:51 user nova-compute[74836]:     </memballoon>
Nov 14 03:30:51 user nova-compute[74836]:   </devices>
Nov 14 03:30:51 user nova-compute[74836]: </domain>
Nov 14 03:30:51 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-424831790',display_name='tempest-ServerRescueNegativeTestJSON-server-424831790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-424831790',id=3,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-2030xd1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:46Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=2a266da1-3823-4ae8-b45c-17c1b7543a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG os_vif [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0713d5ed-0bcb-52b1-8f17-5845dc021c6b', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Instance network_info: |[{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] Acquired lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Refreshing network info cache for port fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Start _get_guest_xml network_info=[{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:30:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:30:51 user sudo[84163]: pam_unix(sudo:session): session closed for user root
Nov 14 03:30:51 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Spawned new privsep daemon via rootwrap
Nov 14 03:30:51 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 03:30:51 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 03:30:51 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 03:30:51 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84166
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686236951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686236951',id=2,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-s3isv4w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:46Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=c8eb5512-0d1f-4355-8ec9-c0cef174c2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:30:51 user nova-compute[74836]:   <uuid>c8eb5512-0d1f-4355-8ec9-c0cef174c2e0</uuid>
Nov 14 03:30:51 user nova-compute[74836]:   <name>instance-00000002</name>
Nov 14 03:30:51 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:30:51 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:30:51 user nova-compute[74836]:   <metadata>
Nov 14 03:30:51 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:30:51 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-686236951</nova:name>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:30:51</nova:creationTime>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:30:51 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:owner>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:owner>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:30:51 user nova-compute[74836]:       <nova:ports>
Nov 14 03:30:51 user nova-compute[74836]:         <nova:port uuid="fcae15f9-d363-4ad3-a487-ec483dea50ba">
Nov 14 03:30:51 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 03:30:51 user nova-compute[74836]:         </nova:port>
Nov 14 03:30:51 user nova-compute[74836]:       </nova:ports>
Nov 14 03:30:51 user nova-compute[74836]:     </nova:instance>
Nov 14 03:30:51 user nova-compute[74836]:   </metadata>
Nov 14 03:30:51 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:30:51 user nova-compute[74836]:     <system>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="serial">c8eb5512-0d1f-4355-8ec9-c0cef174c2e0</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="uuid">c8eb5512-0d1f-4355-8ec9-c0cef174c2e0</entry>
Nov 14 03:30:51 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:30:51 user nova-compute[74836]:     </system>
Nov 14 03:30:51 user nova-compute[74836]:   </sysinfo>
Nov 14 03:30:51 user nova-compute[74836]:   <os>
Nov 14 03:30:51 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:30:51 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:30:51 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:30:51 user nova-compute[74836]:   </os>
Nov 14 03:30:51 user nova-compute[74836]:   <features>
Nov 14 03:30:51 user nova-compute[74836]:     <acpi/>
Nov 14 03:30:51 user nova-compute[74836]:     <apic/>
Nov 14 03:30:51 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:30:51 user nova-compute[74836]:   </features>
Nov 14 03:30:51 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:30:51 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:30:51 user nova-compute[74836]:   </clock>
Nov 14 03:30:51 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:30:51 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:30:51 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:30:51 user nova-compute[74836]:   </cpu>
Nov 14 03:30:51 user nova-compute[74836]:   <devices>
Nov 14 03:30:51 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:30:51 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:30:51 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk"/>
Nov 14 03:30:51 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:     </disk>
Nov 14 03:30:51 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:30:51 user nova-compute[74836]:       <mac address="fa:16:3e:40:27:3c"/>
Nov 14 03:30:51 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:30:51 user nova-compute[74836]:       <target dev="tapfcae15f9-d3"/>
Nov 14 03:30:51 user nova-compute[74836]:     </interface>
Nov 14 03:30:51 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:30:51 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/console.log" append="off"/>
Nov 14 03:30:51 user nova-compute[74836]:     </serial>
Nov 14 03:30:51 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:30:51 user nova-compute[74836]:     <video>
Nov 14 03:30:51 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:51 user nova-compute[74836]:     </video>
Nov 14 03:30:51 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:30:51 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:30:51 user nova-compute[74836]:     </rng>
Nov 14 03:30:51 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:30:51 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:30:51 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:30:51 user nova-compute[74836]:     </memballoon>
Nov 14 03:30:51 user nova-compute[74836]:   </devices>
Nov 14 03:30:51 user nova-compute[74836]: </domain>
Nov 14 03:30:51 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686236951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686236951',id=2,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-s3isv4w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:46Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=c8eb5512-0d1f-4355-8ec9-c0cef174c2e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG os_vif [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8eefbc2b-0f18-5a7e-b6db-de9382e8d8c7', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:51 user nova-compute[74836]: WARNING oslo_privsep.priv_context [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] privsep daemon already running
Nov 14 03:30:51 user nova-compute[74836]: WARNING oslo_privsep.priv_context [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] privsep daemon already running
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Successfully updated port: 8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquired lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updated VIF entry in instance network info cache for port 86d1e467-9870-48ab-9291-033f4f673003. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff45fba5-48d6-40a3-a1e6-b343212d34db req-8953f3b2-3c7a-492a-9480-84a8f326ddeb service nova] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcae15f9-d3, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcae15f9-d3, col_values=(('qos', UUID('c4247a13-f21e-4954-8171-eeb68980b242')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcae15f9-d3, col_values=(('external_ids', {'iface-id': 'fcae15f9-d363-4ad3-a487-ec483dea50ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:27:3c', 'vm-uuid': 'c8eb5512-0d1f-4355-8ec9-c0cef174c2e0'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: INFO os_vif [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3')
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86d1e467-98, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86d1e467-98, col_values=(('qos', UUID('4af1be14-5662-4611-bafc-501f5bd919b2')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86d1e467-98, col_values=(('external_ids', {'iface-id': '86d1e467-9870-48ab-9291-033f4f673003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:ce:e3', 'vm-uuid': '07ea4caa-d030-4ca6-b716-49d37a2d7a0d'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: INFO os_vif [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98')
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6561cb21-a7, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6561cb21-a7, col_values=(('qos', UUID('e905484d-f4f4-48af-9c2e-c6c0040894ad')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6561cb21-a7, col_values=(('external_ids', {'iface-id': '6561cb21-a719-4b80-b0fc-1c6d2e2de49a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:37:d9', 'vm-uuid': '2a266da1-3823-4ae8-b45c-17c1b7543a5a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:52 user nova-compute[74836]: INFO os_vif [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7')
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:01:ce:e3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updated VIF entry in instance network info cache for port 6561cb21-a719-4b80-b0fc-1c6d2e2de49a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-changed-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Refreshing instance network info cache due to event network-changed-8f783eb0-4e54-46ee-a885-3041d40d6417. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] Acquiring lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:40:27:3c, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:48:37:d9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3ccdf0f-3fa1-4b09-9e2e-ef5fabedea98 req-05f06301-19e6-4363-8c22-b3658db642ad service nova] Releasing lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updated VIF entry in instance network info cache for port fcae15f9-d363-4ad3-a487-ec483dea50ba. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:30:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a130bbdb-7b80-486e-8183-cc42b9555ba6 req-0f6c193e-2a5a-4946-8abe-fee3fa530b4a service nova] Releasing lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updating instance_info_cache with network_info: [{"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Releasing lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Instance network_info: |[{"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] Acquired lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Refreshing network info cache for port 8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Start _get_guest_xml network_info=[{"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:30:53 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:53 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752949228',display_name='tempest-ServersNegativeTestJSON-server-752949228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752949228',id=4,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-za7d0j7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:47Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=c6a98f6f-4e96-4b7f-864d-b6ae79521111,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lazy-loading 'pci_devices' on Instance uuid c6a98f6f-4e96-4b7f-864d-b6ae79521111 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:30:53 user nova-compute[74836]:   <uuid>c6a98f6f-4e96-4b7f-864d-b6ae79521111</uuid>
Nov 14 03:30:53 user nova-compute[74836]:   <name>instance-00000004</name>
Nov 14 03:30:53 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:30:53 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:30:53 user nova-compute[74836]:   <metadata>
Nov 14 03:30:53 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:30:53 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:name>tempest-ServersNegativeTestJSON-server-752949228</nova:name>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:30:53</nova:creationTime>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:30:53 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:30:53 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:owner>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:user uuid="ab86e22169934541aaf5599c215eb601">tempest-ServersNegativeTestJSON-1971360444-project-member</nova:user>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:project uuid="300a5c30444b4f93be44cc7580991dc4">tempest-ServersNegativeTestJSON-1971360444</nova:project>
Nov 14 03:30:53 user nova-compute[74836]:       </nova:owner>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:30:53 user nova-compute[74836]:       <nova:ports>
Nov 14 03:30:53 user nova-compute[74836]:         <nova:port uuid="8f783eb0-4e54-46ee-a885-3041d40d6417">
Nov 14 03:30:53 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:30:53 user nova-compute[74836]:         </nova:port>
Nov 14 03:30:53 user nova-compute[74836]:       </nova:ports>
Nov 14 03:30:53 user nova-compute[74836]:     </nova:instance>
Nov 14 03:30:53 user nova-compute[74836]:   </metadata>
Nov 14 03:30:53 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:30:53 user nova-compute[74836]:     <system>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="serial">c6a98f6f-4e96-4b7f-864d-b6ae79521111</entry>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="uuid">c6a98f6f-4e96-4b7f-864d-b6ae79521111</entry>
Nov 14 03:30:53 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:30:53 user nova-compute[74836]:     </system>
Nov 14 03:30:53 user nova-compute[74836]:   </sysinfo>
Nov 14 03:30:53 user nova-compute[74836]:   <os>
Nov 14 03:30:53 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:30:53 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:30:53 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:30:53 user nova-compute[74836]:   </os>
Nov 14 03:30:53 user nova-compute[74836]:   <features>
Nov 14 03:30:53 user nova-compute[74836]:     <acpi/>
Nov 14 03:30:53 user nova-compute[74836]:     <apic/>
Nov 14 03:30:53 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:30:53 user nova-compute[74836]:   </features>
Nov 14 03:30:53 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:30:53 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:30:53 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:30:53 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:30:53 user nova-compute[74836]:   </clock>
Nov 14 03:30:53 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:30:53 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:30:53 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:30:53 user nova-compute[74836]:   </cpu>
Nov 14 03:30:53 user nova-compute[74836]:   <devices>
Nov 14 03:30:53 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:30:53 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:30:53 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk"/>
Nov 14 03:30:53 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:30:53 user nova-compute[74836]:     </disk>
Nov 14 03:30:53 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:30:53 user nova-compute[74836]:       <mac address="fa:16:3e:e4:fc:fb"/>
Nov 14 03:30:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:53 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:30:53 user nova-compute[74836]:       <target dev="tap8f783eb0-4e"/>
Nov 14 03:30:53 user nova-compute[74836]:     </interface>
Nov 14 03:30:53 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:30:53 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/console.log" append="off"/>
Nov 14 03:30:53 user nova-compute[74836]:     </serial>
Nov 14 03:30:53 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:30:53 user nova-compute[74836]:     <video>
Nov 14 03:30:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:53 user nova-compute[74836]:     </video>
Nov 14 03:30:53 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:30:53 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:30:53 user nova-compute[74836]:     </rng>
Nov 14 03:30:53 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:30:53 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:30:53 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:30:53 user nova-compute[74836]:     </memballoon>
Nov 14 03:30:53 user nova-compute[74836]:   </devices>
Nov 14 03:30:53 user nova-compute[74836]: </domain>
Nov 14 03:30:53 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752949228',display_name='tempest-ServersNegativeTestJSON-server-752949228',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752949228',id=4,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-za7d0j7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:47Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=c6a98f6f-4e96-4b7f-864d-b6ae79521111,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG os_vif [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfae862d-8222-5bfd-9fde-cb3f738ba7f1', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f783eb0-4e, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f783eb0-4e, col_values=(('qos', UUID('96930af7-e207-4473-95c7-abab3feb6ffe')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f783eb0-4e, col_values=(('external_ids', {'iface-id': '8f783eb0-4e54-46ee-a885-3041d40d6417', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:fc:fb', 'vm-uuid': 'c6a98f6f-4e96-4b7f-864d-b6ae79521111'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:53 user nova-compute[74836]: INFO os_vif [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e')
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:30:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] No VIF found with MAC fa:16:3e:e4:fc:fb, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:30:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updated VIF entry in instance network info cache for port 8f783eb0-4e54-46ee-a885-3041d40d6417. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:30:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updating instance_info_cache with network_info: [{"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51df68b4-f4ce-4f45-8aa3-4a2af01dbd25 req-b514714c-54ed-49bf-a5c7-b5ac6673cf2f service nova] Releasing lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:30:55 user nova-compute[74836]: INFO nova.compute.claims [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Claim successful on node user
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:30:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:30:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:30:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Creating image(s)
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "/opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.policy [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9aff38e58fe4a1b8bd4d46ceda55ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e7a009680c4c6d80ab5bb26d05b100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.218s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk 1073741824" returned: 0 in 0.108s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.323s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Successfully created port: a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Cannot resize image /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Ensure instance console log exists: /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Successfully updated port: a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing instance network info cache due to event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:30:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Instance network_info: |[{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Start _get_guest_xml network_info=[{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:30:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2118649159',display_name='tempest-ServerActionsTestOtherA-server-2118649159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2118649159',id=5,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-g0yukk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'pci_devices' on Instance uuid 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:30:58 user nova-compute[74836]:   <uuid>96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571</uuid>
Nov 14 03:30:58 user nova-compute[74836]:   <name>instance-00000005</name>
Nov 14 03:30:58 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:30:58 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:30:58 user nova-compute[74836]:   <metadata>
Nov 14 03:30:58 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:30:58 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherA-server-2118649159</nova:name>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:30:58</nova:creationTime>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:30:58 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:30:58 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:owner>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:user uuid="f9aff38e58fe4a1b8bd4d46ceda55ba3">tempest-ServerActionsTestOtherA-585001335-project-member</nova:user>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:project uuid="06e7a009680c4c6d80ab5bb26d05b100">tempest-ServerActionsTestOtherA-585001335</nova:project>
Nov 14 03:30:58 user nova-compute[74836]:       </nova:owner>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:30:58 user nova-compute[74836]:       <nova:ports>
Nov 14 03:30:58 user nova-compute[74836]:         <nova:port uuid="a59ca6c0-1a41-4d14-9de7-f56d96dcee3b">
Nov 14 03:30:58 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:30:58 user nova-compute[74836]:         </nova:port>
Nov 14 03:30:58 user nova-compute[74836]:       </nova:ports>
Nov 14 03:30:58 user nova-compute[74836]:     </nova:instance>
Nov 14 03:30:58 user nova-compute[74836]:   </metadata>
Nov 14 03:30:58 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:30:58 user nova-compute[74836]:     <system>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="serial">96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571</entry>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="uuid">96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571</entry>
Nov 14 03:30:58 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:30:58 user nova-compute[74836]:     </system>
Nov 14 03:30:58 user nova-compute[74836]:   </sysinfo>
Nov 14 03:30:58 user nova-compute[74836]:   <os>
Nov 14 03:30:58 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:30:58 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:30:58 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:30:58 user nova-compute[74836]:   </os>
Nov 14 03:30:58 user nova-compute[74836]:   <features>
Nov 14 03:30:58 user nova-compute[74836]:     <acpi/>
Nov 14 03:30:58 user nova-compute[74836]:     <apic/>
Nov 14 03:30:58 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:30:58 user nova-compute[74836]:   </features>
Nov 14 03:30:58 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:30:58 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:30:58 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:30:58 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:30:58 user nova-compute[74836]:   </clock>
Nov 14 03:30:58 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:30:58 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:30:58 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:30:58 user nova-compute[74836]:   </cpu>
Nov 14 03:30:58 user nova-compute[74836]:   <devices>
Nov 14 03:30:58 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:30:58 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:30:58 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk"/>
Nov 14 03:30:58 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:30:58 user nova-compute[74836]:     </disk>
Nov 14 03:30:58 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:30:58 user nova-compute[74836]:       <mac address="fa:16:3e:ac:a7:32"/>
Nov 14 03:30:58 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:58 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:30:58 user nova-compute[74836]:       <target dev="tapa59ca6c0-1a"/>
Nov 14 03:30:58 user nova-compute[74836]:     </interface>
Nov 14 03:30:58 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:30:58 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/console.log" append="off"/>
Nov 14 03:30:58 user nova-compute[74836]:     </serial>
Nov 14 03:30:58 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:30:58 user nova-compute[74836]:     <video>
Nov 14 03:30:58 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:30:58 user nova-compute[74836]:     </video>
Nov 14 03:30:58 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:30:58 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:30:58 user nova-compute[74836]:     </rng>
Nov 14 03:30:58 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:30:58 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:30:58 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:30:58 user nova-compute[74836]:     </memballoon>
Nov 14 03:30:58 user nova-compute[74836]:   </devices>
Nov 14 03:30:58 user nova-compute[74836]: </domain>
Nov 14 03:30:58 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2118649159',display_name='tempest-ServerActionsTestOtherA-server-2118649159',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2118649159',id=5,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-g0yukk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:30:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG os_vif [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8066c5d6-9b26-57cc-950c-84f51014eef7', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa59ca6c0-1a, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa59ca6c0-1a, col_values=(('qos', UUID('a26652fa-77db-4c36-9f7e-78b468c415c8')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa59ca6c0-1a, col_values=(('external_ids', {'iface-id': 'a59ca6c0-1a41-4d14-9de7-f56d96dcee3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:a7:32', 'vm-uuid': '96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:30:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:30:58 user nova-compute[74836]: INFO os_vif [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a')
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:ac:a7:32, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:30:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance spawned successfully.
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:30:59 user nova-compute[74836]: WARNING nova.compute.manager [req-73191d6e-fd79-4bf1-abef-307236fe8827 req-6e84a36e-8863-4231-a723-34fa252c5516 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state building and task_state spawning.
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated VIF entry in instance network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:30:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2389aea-5ce5-4e40-bb10-6d4ca6baea8f req-2bfe4551-ffb4-4fcd-a486-d94ba907b156 service nova] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:30:59 user nova-compute[74836]: INFO nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Took 15.73 seconds to spawn the instance on the hypervisor.
Nov 14 03:30:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:30:59 user nova-compute[74836]: INFO nova.compute.manager [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Took 16.78 seconds to build instance.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6f622db1-f150-4d4a-83dd-933193f577d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.974s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance spawned successfully.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Instance spawned successfully.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Took 14.36 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Took 14.78 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.compute.manager [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Took 15.20 seconds to build instance.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a92000aa-384c-455c-ac68-8f30bd0c9340 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.395s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:00 user nova-compute[74836]: INFO nova.compute.manager [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Took 15.91 seconds to build instance.
Nov 14 03:31:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c00c6d95-4aa4-44df-89c7-d4ecea9d7e7e tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.159s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:01 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Instance spawned successfully.
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:01 user nova-compute[74836]: INFO nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Took 14.05 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:01 user nova-compute[74836]: INFO nova.compute.manager [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Took 14.99 seconds to build instance.
Nov 14 03:31:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4485140c-b42e-4794-a6b2-2ce88a25e723 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.172s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:01 user nova-compute[74836]: WARNING nova.compute.manager [req-c3200b2c-e1c4-42e3-bf46-57950908ea14 req-a960ca4c-f327-4720-8ed4-af08fe8ebda6 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state active and task_state None.
Nov 14 03:31:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Instance spawned successfully.
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:04 user nova-compute[74836]: INFO nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Took 8.46 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:04 user nova-compute[74836]: INFO nova.compute.manager [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Took 9.45 seconds to build instance.
Nov 14 03:31:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d3d0811-731c-4cad-aa61-7f43a3802671 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.574s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:10 user nova-compute[74836]: WARNING nova.compute.manager [req-d0f60cb7-9d7a-4d71-b4e2-21520fbfee00 req-d2afb02f-6567-476f-9df3-a11a99279fc2 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state None.
Nov 14 03:31:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:12 user nova-compute[74836]: WARNING nova.compute.manager [req-fdd9b2c2-5fa1-497d-b0fc-491065f8884c req-3e6be98d-38c4-4294-a4ce-4bb5a14d8917 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state None.
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:13 user nova-compute[74836]: INFO nova.compute.claims [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Claim successful on node user
Nov 14 03:31:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:13 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.505s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:14 user nova-compute[74836]: INFO nova.compute.claims [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Claim successful on node user
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:14 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.policy [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e50f7a1efbbb42918795aaa6f67b04f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5408be71c29b4403a7056c0323d23e3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:14 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Creating image(s)
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "/opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "/opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "/opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.131s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.263s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:14 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:14 user nova-compute[74836]: INFO nova.compute.claims [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Claim successful on node user
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.306s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk 1073741824" returned: 0 in 0.082s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.393s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Creating image(s)
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "/opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "/opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "/opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.policy [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b7f7df6faa7429db3e3806475f5e1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08fb1eaebb24491ba633597c0c916bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.377s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.323s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.009s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Successfully created port: a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.342s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Cannot resize image /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Ensure instance console log exists: /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.252s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.216s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk 1073741824" returned: 0 in 0.067s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Checking if we can resize image /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Cannot resize image /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Ensure instance console log exists: /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Successfully created port: a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.policy [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b140c51aa00346a087a73f715872fbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22b90ab4b5f44cd8bb9a796ea8a4c7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Creating image(s)
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "/opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "/opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "/opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.042s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.236s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:17 user nova-compute[74836]: INFO nova.compute.claims [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Claim successful on node user
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.311s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk 1073741824" returned: 0 in 0.078s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Successfully updated port: a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Successfully updated port: a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquired lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Successfully created port: b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-changed-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Refreshing instance network info cache due to event network-changed-a53f7b05-8589-4d3f-9fb5-91dd0183e561. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] Acquiring lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquired lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.260s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-changed-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Refreshing instance network info cache due to event network-changed-a8ca537d-1602-45a5-a67a-d6ec0f52be7b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] Acquiring lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Cannot resize image /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Ensure instance console log exists: /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:17 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating instance_info_cache with network_info: [{"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Releasing lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Instance network_info: |[{"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] Acquired lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Refreshing network info cache for port a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Start _get_guest_xml network_info=[{"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-462570854',display_name='tempest-TestVolumeSwap-server-462570854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-462570854',id=7,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHpcyyoFS/Z+11JnxXFp1NRg/FBmOfhGUF7tQILoBc3t84pj3VP7m7OfxGSolmL9x5R3QhfigD33EUnYZqeAo0Qw+y5pnpb9gVVpmGFMNeAcKDk93oopyY3raFffhuqZg==',key_name='tempest-keypair-1355804785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5408be71c29b4403a7056c0323d23e3d',ramdisk_id='',reservation_id='r-jxc4c1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1733835192',owner_user_name='tempest-TestVolumeSwap-1733835192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e50f7a1efbbb42918795aaa6f67b04f9',uuid=f197c8c0-6f1b-4b38-93fc-309e598a4eb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converting VIF {"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lazy-loading 'pci_devices' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Updating instance_info_cache with network_info: [{"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:18 user nova-compute[74836]:   <uuid>f197c8c0-6f1b-4b38-93fc-309e598a4eb6</uuid>
Nov 14 03:31:18 user nova-compute[74836]:   <name>instance-00000007</name>
Nov 14 03:31:18 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:18 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:18 user nova-compute[74836]:   <metadata>
Nov 14 03:31:18 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:18 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:name>tempest-TestVolumeSwap-server-462570854</nova:name>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:18</nova:creationTime>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:18 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:user uuid="e50f7a1efbbb42918795aaa6f67b04f9">tempest-TestVolumeSwap-1733835192-project-member</nova:user>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:project uuid="5408be71c29b4403a7056c0323d23e3d">tempest-TestVolumeSwap-1733835192</nova:project>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:port uuid="a53f7b05-8589-4d3f-9fb5-91dd0183e561">
Nov 14 03:31:18 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 03:31:18 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:18 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:18 user nova-compute[74836]:   </metadata>
Nov 14 03:31:18 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:18 user nova-compute[74836]:     <system>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="serial">f197c8c0-6f1b-4b38-93fc-309e598a4eb6</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="uuid">f197c8c0-6f1b-4b38-93fc-309e598a4eb6</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:18 user nova-compute[74836]:     </system>
Nov 14 03:31:18 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:18 user nova-compute[74836]:   <os>
Nov 14 03:31:18 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:18 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:18 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:18 user nova-compute[74836]:   </os>
Nov 14 03:31:18 user nova-compute[74836]:   <features>
Nov 14 03:31:18 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:18 user nova-compute[74836]:     <apic/>
Nov 14 03:31:18 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:18 user nova-compute[74836]:   </features>
Nov 14 03:31:18 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:18 user nova-compute[74836]:   </clock>
Nov 14 03:31:18 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:18 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:18 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:18 user nova-compute[74836]:   </cpu>
Nov 14 03:31:18 user nova-compute[74836]:   <devices>
Nov 14 03:31:18 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:18 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:18 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk"/>
Nov 14 03:31:18 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:     </disk>
Nov 14 03:31:18 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:18 user nova-compute[74836]:       <mac address="fa:16:3e:08:96:a9"/>
Nov 14 03:31:18 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:18 user nova-compute[74836]:       <target dev="tapa53f7b05-85"/>
Nov 14 03:31:18 user nova-compute[74836]:     </interface>
Nov 14 03:31:18 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:18 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/console.log" append="off"/>
Nov 14 03:31:18 user nova-compute[74836]:     </serial>
Nov 14 03:31:18 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:18 user nova-compute[74836]:     <video>
Nov 14 03:31:18 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:     </video>
Nov 14 03:31:18 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:18 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:18 user nova-compute[74836]:     </rng>
Nov 14 03:31:18 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:18 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:18 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:18 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:18 user nova-compute[74836]:   </devices>
Nov 14 03:31:18 user nova-compute[74836]: </domain>
Nov 14 03:31:18 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-462570854',display_name='tempest-TestVolumeSwap-server-462570854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-462570854',id=7,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHpcyyoFS/Z+11JnxXFp1NRg/FBmOfhGUF7tQILoBc3t84pj3VP7m7OfxGSolmL9x5R3QhfigD33EUnYZqeAo0Qw+y5pnpb9gVVpmGFMNeAcKDk93oopyY3raFffhuqZg==',key_name='tempest-keypair-1355804785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5408be71c29b4403a7056c0323d23e3d',ramdisk_id='',reservation_id='r-jxc4c1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1733835192',owner_user_name='tempest-TestVolumeSwap-1733835192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e50f7a1efbbb42918795aaa6f67b04f9',uuid=f197c8c0-6f1b-4b38-93fc-309e598a4eb6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converting VIF {"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG os_vif [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab563d8e-fe6d-580e-9271-03c919355604', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Releasing lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Instance network_info: |[{"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] Acquired lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Refreshing network info cache for port a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Start _get_guest_xml network_info=[{"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa53f7b05-85, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa53f7b05-85, col_values=(('qos', UUID('8aff6126-b51c-41c3-9f05-25ca79becd88')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa53f7b05-85, col_values=(('external_ids', {'iface-id': 'a53f7b05-8589-4d3f-9fb5-91dd0183e561', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:96:a9', 'vm-uuid': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: INFO os_vif [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85')
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.policy [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16a50580518a437a9743ec1ad6c05ad1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '491c715ecd0248099544356e775044d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Successfully updated port: b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Creating image(s)
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "/opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "/opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "/opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquired lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-changed-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Refreshing instance network info cache due to event network-changed-b81a7dc1-60d9-4d8f-a556-82175a45fa82. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] Acquiring lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306554489',display_name='tempest-VolumesActionsTest-instance-1306554489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306554489',id=6,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08fb1eaebb24491ba633597c0c916bb',ramdisk_id='',reservation_id='r-x4zmijbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1690932671',owner_user_name='tempest-VolumesActionsTest-1690932671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:15Z,user_data=None,user_id='8b7f7df6faa7429db3e3806475f5e1bc',uuid=685d82a2-1328-48ec-8899-4e8b103c969f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converting VIF {"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lazy-loading 'pci_devices' on Instance uuid 685d82a2-1328-48ec-8899-4e8b103c969f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:18 user nova-compute[74836]:   <uuid>685d82a2-1328-48ec-8899-4e8b103c969f</uuid>
Nov 14 03:31:18 user nova-compute[74836]:   <name>instance-00000006</name>
Nov 14 03:31:18 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:18 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:18 user nova-compute[74836]:   <metadata>
Nov 14 03:31:18 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:18 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:name>tempest-VolumesActionsTest-instance-1306554489</nova:name>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:18</nova:creationTime>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:18 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:user uuid="8b7f7df6faa7429db3e3806475f5e1bc">tempest-VolumesActionsTest-1690932671-project-member</nova:user>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:project uuid="c08fb1eaebb24491ba633597c0c916bb">tempest-VolumesActionsTest-1690932671</nova:project>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:18 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:18 user nova-compute[74836]:         <nova:port uuid="a8ca537d-1602-45a5-a67a-d6ec0f52be7b">
Nov 14 03:31:18 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:31:18 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:18 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:18 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:18 user nova-compute[74836]:   </metadata>
Nov 14 03:31:18 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:18 user nova-compute[74836]:     <system>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="serial">685d82a2-1328-48ec-8899-4e8b103c969f</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="uuid">685d82a2-1328-48ec-8899-4e8b103c969f</entry>
Nov 14 03:31:18 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:18 user nova-compute[74836]:     </system>
Nov 14 03:31:18 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:18 user nova-compute[74836]:   <os>
Nov 14 03:31:18 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:18 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:18 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:18 user nova-compute[74836]:   </os>
Nov 14 03:31:18 user nova-compute[74836]:   <features>
Nov 14 03:31:18 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:18 user nova-compute[74836]:     <apic/>
Nov 14 03:31:18 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:18 user nova-compute[74836]:   </features>
Nov 14 03:31:18 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:18 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:18 user nova-compute[74836]:   </clock>
Nov 14 03:31:18 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:18 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:18 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:18 user nova-compute[74836]:   </cpu>
Nov 14 03:31:18 user nova-compute[74836]:   <devices>
Nov 14 03:31:18 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:18 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:18 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk"/>
Nov 14 03:31:18 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:     </disk>
Nov 14 03:31:18 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:18 user nova-compute[74836]:       <mac address="fa:16:3e:24:e2:db"/>
Nov 14 03:31:18 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:18 user nova-compute[74836]:       <target dev="tapa8ca537d-16"/>
Nov 14 03:31:18 user nova-compute[74836]:     </interface>
Nov 14 03:31:18 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:18 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/console.log" append="off"/>
Nov 14 03:31:18 user nova-compute[74836]:     </serial>
Nov 14 03:31:18 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:18 user nova-compute[74836]:     <video>
Nov 14 03:31:18 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:18 user nova-compute[74836]:     </video>
Nov 14 03:31:18 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:18 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:18 user nova-compute[74836]:     </rng>
Nov 14 03:31:18 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:18 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:18 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:18 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:18 user nova-compute[74836]:   </devices>
Nov 14 03:31:18 user nova-compute[74836]: </domain>
Nov 14 03:31:18 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306554489',display_name='tempest-VolumesActionsTest-instance-1306554489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306554489',id=6,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08fb1eaebb24491ba633597c0c916bb',ramdisk_id='',reservation_id='r-x4zmijbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1690932671',owner_user_name='tempest-VolumesActionsTest-1690932671-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:15Z,user_data=None,user_id='8b7f7df6faa7429db3e3806475f5e1bc',uuid=685d82a2-1328-48ec-8899-4e8b103c969f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converting VIF {"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG os_vif [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aba71c3-8a27-5907-9ba2-93718b18facc', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] No VIF found with MAC fa:16:3e:08:96:a9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8ca537d-16, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8ca537d-16, col_values=(('qos', UUID('ae47bd6e-8e1e-449f-8181-2e4b1610c82b')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8ca537d-16, col_values=(('external_ids', {'iface-id': 'a8ca537d-1602-45a5-a67a-d6ec0f52be7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:e2:db', 'vm-uuid': '685d82a2-1328-48ec-8899-4e8b103c969f'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:18 user nova-compute[74836]: INFO os_vif [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16')
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.219s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] No VIF found with MAC fa:16:3e:24:e2:db, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk 1073741824" returned: 0 in 0.050s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Releasing lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Instance network_info: |[{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] Acquired lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.network.neutron [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Refreshing network info cache for port b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Start _get_guest_xml network_info=[{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-898931746',display_name='tempest-VolumesAdminNegativeTest-server-898931746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-898931746',id=8,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi1sBR9vjVragWKGUi5Lxx/7gqvpKdwUOPH0olvziny29MUFd/w6wmIan0RTKF/CnbaES7UpTeT94lDextEBqChJTeuOqWS/qDl6dgQMHZrtYQzNpkNVsPoVFrLukGspw==',key_name='tempest-keypair-1470069867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-ddhabs9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b140c51aa00346a087a73f715872fbff',uuid=a767ef19-4fe9-4854-aa8f-f769b5d13378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'pci_devices' on Instance uuid a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Updated VIF entry in instance network info cache for port a8ca537d-1602-45a5-a67a-d6ec0f52be7b. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Updating instance_info_cache with network_info: [{"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:19 user nova-compute[74836]:   <uuid>a767ef19-4fe9-4854-aa8f-f769b5d13378</uuid>
Nov 14 03:31:19 user nova-compute[74836]:   <name>instance-00000008</name>
Nov 14 03:31:19 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:19 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:19 user nova-compute[74836]:   <metadata>
Nov 14 03:31:19 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:19 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:name>tempest-VolumesAdminNegativeTest-server-898931746</nova:name>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:18</nova:creationTime>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:19 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:19 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:user uuid="b140c51aa00346a087a73f715872fbff">tempest-VolumesAdminNegativeTest-2038430318-project-member</nova:user>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:project uuid="f22b90ab4b5f44cd8bb9a796ea8a4c7e">tempest-VolumesAdminNegativeTest-2038430318</nova:project>
Nov 14 03:31:19 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:19 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:19 user nova-compute[74836]:         <nova:port uuid="b81a7dc1-60d9-4d8f-a556-82175a45fa82">
Nov 14 03:31:19 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:31:19 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:19 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:19 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:19 user nova-compute[74836]:   </metadata>
Nov 14 03:31:19 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:19 user nova-compute[74836]:     <system>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="serial">a767ef19-4fe9-4854-aa8f-f769b5d13378</entry>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="uuid">a767ef19-4fe9-4854-aa8f-f769b5d13378</entry>
Nov 14 03:31:19 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:19 user nova-compute[74836]:     </system>
Nov 14 03:31:19 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:19 user nova-compute[74836]:   <os>
Nov 14 03:31:19 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:19 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:19 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:19 user nova-compute[74836]:   </os>
Nov 14 03:31:19 user nova-compute[74836]:   <features>
Nov 14 03:31:19 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:19 user nova-compute[74836]:     <apic/>
Nov 14 03:31:19 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:19 user nova-compute[74836]:   </features>
Nov 14 03:31:19 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:19 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:19 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:19 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:19 user nova-compute[74836]:   </clock>
Nov 14 03:31:19 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:19 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:19 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:19 user nova-compute[74836]:   </cpu>
Nov 14 03:31:19 user nova-compute[74836]:   <devices>
Nov 14 03:31:19 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:19 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:19 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk"/>
Nov 14 03:31:19 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:19 user nova-compute[74836]:     </disk>
Nov 14 03:31:19 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:19 user nova-compute[74836]:       <mac address="fa:16:3e:ec:95:f8"/>
Nov 14 03:31:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:19 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:19 user nova-compute[74836]:       <target dev="tapb81a7dc1-60"/>
Nov 14 03:31:19 user nova-compute[74836]:     </interface>
Nov 14 03:31:19 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:19 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/console.log" append="off"/>
Nov 14 03:31:19 user nova-compute[74836]:     </serial>
Nov 14 03:31:19 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:19 user nova-compute[74836]:     <video>
Nov 14 03:31:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:19 user nova-compute[74836]:     </video>
Nov 14 03:31:19 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:19 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:19 user nova-compute[74836]:     </rng>
Nov 14 03:31:19 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:19 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:19 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:19 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:19 user nova-compute[74836]:   </devices>
Nov 14 03:31:19 user nova-compute[74836]: </domain>
Nov 14 03:31:19 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-898931746',display_name='tempest-VolumesAdminNegativeTest-server-898931746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-898931746',id=8,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi1sBR9vjVragWKGUi5Lxx/7gqvpKdwUOPH0olvziny29MUFd/w6wmIan0RTKF/CnbaES7UpTeT94lDextEBqChJTeuOqWS/qDl6dgQMHZrtYQzNpkNVsPoVFrLukGspw==',key_name='tempest-keypair-1470069867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-ddhabs9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b140c51aa00346a087a73f715872fbff',uuid=a767ef19-4fe9-4854-aa8f-f769b5d13378,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG os_vif [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '43dc8e97-6e8b-57b9-ad80-1d5850892f3d', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80fd0de-100c-473d-9ed8-bdc26b702589 req-40d68276-fb0e-4a45-86cf-fa58e56e1d33 service nova] Releasing lock "refresh_cache-685d82a2-1328-48ec-8899-4e8b103c969f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb81a7dc1-60, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb81a7dc1-60, col_values=(('qos', UUID('64a4af32-2bda-4698-b09d-d32aa42be419')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb81a7dc1-60, col_values=(('external_ids', {'iface-id': 'b81a7dc1-60d9-4d8f-a556-82175a45fa82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:95:f8', 'vm-uuid': 'a767ef19-4fe9-4854-aa8f-f769b5d13378'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:19 user nova-compute[74836]: INFO os_vif [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60')
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updated VIF entry in instance network info cache for port a53f7b05-8589-4d3f-9fb5-91dd0183e561. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating instance_info_cache with network_info: [{"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9874b50a-f03f-4c41-a01c-cf4cf68b8ed9 req-39cab42a-aef1-499a-aff4-243f1d7816f5 service nova] Releasing lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No VIF found with MAC fa:16:3e:ec:95:f8, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Cannot resize image /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Ensure instance console log exists: /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updated VIF entry in instance network info cache for port b81a7dc1-60d9-4d8f-a556-82175a45fa82. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02931067-7549-4dcd-9ee0-55786aaea313 req-7a866b33-58b8-40df-85fe-63f2f0a666a1 service nova] Releasing lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Successfully created port: 79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:20 user nova-compute[74836]: INFO nova.compute.claims [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Claim successful on node user
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Successfully updated port: 79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquired lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-changed-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Refreshing instance network info cache due to event network-changed-79ce1783-30d6-4807-a2bc-5811999bce54. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] Acquiring lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating instance_info_cache with network_info: [{"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Releasing lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Instance network_info: |[{"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] Acquired lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Refreshing network info cache for port 79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Start _get_guest_xml network_info=[{"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:20 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:20 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1263424773',display_name='tempest-VolumesAssistedSnapshotsTest-server-1263424773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1263424773',id=9,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdn9dqya9Sdvy0luAx9Gy1+zLJ/X+cqDQP6RyuEmL1CRCMGkg0JtQ9OQsgs0oRUE4SRksBWHNZVeNoiDb6oic8p9ZwWWBtpag6RFefyqLkSg1fPgyXRzlhYi2RB4AlNYA==',key_name='tempest-keypair-1864994356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491c715ecd0248099544356e775044d8',ramdisk_id='',reservation_id='r-6q7cxelp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1912561792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1912561792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16a50580518a437a9743ec1ad6c05ad1',uuid=56d5cc32-4db6-47c7-9e55-10a01c771c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converting VIF {"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.objects.instance [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lazy-loading 'pci_devices' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:20 user nova-compute[74836]:   <uuid>56d5cc32-4db6-47c7-9e55-10a01c771c17</uuid>
Nov 14 03:31:20 user nova-compute[74836]:   <name>instance-00000009</name>
Nov 14 03:31:20 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:20 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:20 user nova-compute[74836]:   <metadata>
Nov 14 03:31:20 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:20 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1263424773</nova:name>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:20</nova:creationTime>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:20 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:20 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:user uuid="16a50580518a437a9743ec1ad6c05ad1">tempest-VolumesAssistedSnapshotsTest-1912561792-project-member</nova:user>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:project uuid="491c715ecd0248099544356e775044d8">tempest-VolumesAssistedSnapshotsTest-1912561792</nova:project>
Nov 14 03:31:20 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:20 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:20 user nova-compute[74836]:         <nova:port uuid="79ce1783-30d6-4807-a2bc-5811999bce54">
Nov 14 03:31:20 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 03:31:20 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:20 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:20 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:20 user nova-compute[74836]:   </metadata>
Nov 14 03:31:20 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:20 user nova-compute[74836]:     <system>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="serial">56d5cc32-4db6-47c7-9e55-10a01c771c17</entry>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="uuid">56d5cc32-4db6-47c7-9e55-10a01c771c17</entry>
Nov 14 03:31:20 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:20 user nova-compute[74836]:     </system>
Nov 14 03:31:20 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:20 user nova-compute[74836]:   <os>
Nov 14 03:31:20 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:20 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:20 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:20 user nova-compute[74836]:   </os>
Nov 14 03:31:20 user nova-compute[74836]:   <features>
Nov 14 03:31:20 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:20 user nova-compute[74836]:     <apic/>
Nov 14 03:31:20 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:20 user nova-compute[74836]:   </features>
Nov 14 03:31:20 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:20 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:20 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:20 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:20 user nova-compute[74836]:   </clock>
Nov 14 03:31:20 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:20 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:20 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:20 user nova-compute[74836]:   </cpu>
Nov 14 03:31:20 user nova-compute[74836]:   <devices>
Nov 14 03:31:20 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:20 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:20 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk"/>
Nov 14 03:31:20 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:20 user nova-compute[74836]:     </disk>
Nov 14 03:31:20 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:20 user nova-compute[74836]:       <mac address="fa:16:3e:de:68:7b"/>
Nov 14 03:31:20 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:20 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:20 user nova-compute[74836]:       <target dev="tap79ce1783-30"/>
Nov 14 03:31:20 user nova-compute[74836]:     </interface>
Nov 14 03:31:20 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:20 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/console.log" append="off"/>
Nov 14 03:31:20 user nova-compute[74836]:     </serial>
Nov 14 03:31:20 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:20 user nova-compute[74836]:     <video>
Nov 14 03:31:20 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:20 user nova-compute[74836]:     </video>
Nov 14 03:31:20 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:20 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:20 user nova-compute[74836]:     </rng>
Nov 14 03:31:20 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:20 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:20 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:20 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:20 user nova-compute[74836]:   </devices>
Nov 14 03:31:20 user nova-compute[74836]: </domain>
Nov 14 03:31:20 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1263424773',display_name='tempest-VolumesAssistedSnapshotsTest-server-1263424773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1263424773',id=9,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdn9dqya9Sdvy0luAx9Gy1+zLJ/X+cqDQP6RyuEmL1CRCMGkg0JtQ9OQsgs0oRUE4SRksBWHNZVeNoiDb6oic8p9ZwWWBtpag6RFefyqLkSg1fPgyXRzlhYi2RB4AlNYA==',key_name='tempest-keypair-1864994356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='491c715ecd0248099544356e775044d8',ramdisk_id='',reservation_id='r-6q7cxelp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1912561792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1912561792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16a50580518a437a9743ec1ad6c05ad1',uuid=56d5cc32-4db6-47c7-9e55-10a01c771c17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converting VIF {"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG os_vif [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cb85167-9b2b-5ae3-85c8-84e621e3260e', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG nova.policy [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bb4bac46228411d958d4df9fa54b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f166a74a4e54512b8d727d6a7648df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79ce1783-30, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79ce1783-30, col_values=(('qos', UUID('391e4e22-3ba0-4d2a-928d-ce42d148026e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79ce1783-30, col_values=(('external_ids', {'iface-id': '79ce1783-30d6-4807-a2bc-5811999bce54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:68:7b', 'vm-uuid': '56d5cc32-4db6-47c7-9e55-10a01c771c17'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:20 user nova-compute[74836]: INFO os_vif [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30')
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] No VIF found with MAC fa:16:3e:de:68:7b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:21 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Creating image(s)
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updated VIF entry in instance network info cache for port 79ce1783-30d6-4807-a2bc-5811999bce54. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating instance_info_cache with network_info: [{"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.243s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cfcb6f-ea9b-4197-b3ac-53d8a11cf9ca req-3227cdee-d538-4445-8568-46192219c98c service nova] Releasing lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk 1073741824" returned: 0 in 0.105s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.369s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Successfully created port: c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.298s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] No waiting events found dispatching network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:22 user nova-compute[74836]: WARNING nova.compute.manager [req-1512ab97-3d6a-4b05-8e6e-7265adf35fc1 req-16de19b1-5c9c-4da6-a04b-48ed021bacc8 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received unexpected event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b for instance with vm_state building and task_state spawning.
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Cannot resize image /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Ensure instance console log exists: /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Successfully updated port: c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-changed-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing instance network info cache due to event network-changed-c2f23a72-6538-48c5-b99b-e85a17a513fb. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Instance network_info: |[{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.neutron [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing network info cache for port c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Start _get_guest_xml network_info=[{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'pci_devices' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:23 user nova-compute[74836]:   <uuid>93de60b4-700f-4284-a8d9-73130522d402</uuid>
Nov 14 03:31:23 user nova-compute[74836]:   <name>instance-0000000a</name>
Nov 14 03:31:23 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:23 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:23 user nova-compute[74836]:   <metadata>
Nov 14 03:31:23 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:23 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:23</nova:creationTime>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:23 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:23 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:31:23 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:23 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:23 user nova-compute[74836]:         <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:31:23 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:31:23 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:23 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:23 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:23 user nova-compute[74836]:   </metadata>
Nov 14 03:31:23 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:23 user nova-compute[74836]:     <system>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="serial">93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="uuid">93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:31:23 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:23 user nova-compute[74836]:     </system>
Nov 14 03:31:23 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:23 user nova-compute[74836]:   <os>
Nov 14 03:31:23 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:23 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:23 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:23 user nova-compute[74836]:   </os>
Nov 14 03:31:23 user nova-compute[74836]:   <features>
Nov 14 03:31:23 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:23 user nova-compute[74836]:     <apic/>
Nov 14 03:31:23 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:23 user nova-compute[74836]:   </features>
Nov 14 03:31:23 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:23 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:23 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:23 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:23 user nova-compute[74836]:   </clock>
Nov 14 03:31:23 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:23 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:23 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:23 user nova-compute[74836]:   </cpu>
Nov 14 03:31:23 user nova-compute[74836]:   <devices>
Nov 14 03:31:23 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:23 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:23 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk"/>
Nov 14 03:31:23 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:23 user nova-compute[74836]:     </disk>
Nov 14 03:31:23 user nova-compute[74836]:     <disk type="file" device="cdrom">
Nov 14 03:31:23 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 03:31:23 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config"/>
Nov 14 03:31:23 user nova-compute[74836]:       <target dev="hda" bus="ide"/>
Nov 14 03:31:23 user nova-compute[74836]:     </disk>
Nov 14 03:31:23 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:23 user nova-compute[74836]:       <mac address="fa:16:3e:d9:ea:94"/>
Nov 14 03:31:23 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:23 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:23 user nova-compute[74836]:       <target dev="tapc2f23a72-65"/>
Nov 14 03:31:23 user nova-compute[74836]:     </interface>
Nov 14 03:31:23 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:23 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log" append="off"/>
Nov 14 03:31:23 user nova-compute[74836]:     </serial>
Nov 14 03:31:23 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:23 user nova-compute[74836]:     <video>
Nov 14 03:31:23 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:23 user nova-compute[74836]:     </video>
Nov 14 03:31:23 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:23 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:23 user nova-compute[74836]:     </rng>
Nov 14 03:31:23 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:23 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:23 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:23 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:23 user nova-compute[74836]:   </devices>
Nov 14 03:31:23 user nova-compute[74836]: </domain>
Nov 14 03:31:23 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG os_vif [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a03e7974-0591-5523-ba06-a8b0f245577e', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2f23a72-65, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2f23a72-65, col_values=(('qos', UUID('57d4ae7a-0996-4df9-89ae-cfb5a731730d')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2f23a72-65, col_values=(('external_ids', {'iface-id': 'c2f23a72-6538-48c5-b99b-e85a17a513fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:ea:94', 'vm-uuid': '93de60b4-700f-4284-a8d9-73130522d402'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: INFO os_vif [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65')
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name hda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No VIF found with MAC fa:16:3e:d9:ea:94, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Using config drive
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.neutron [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updated VIF entry in instance network info cache for port c2f23a72-6538-48c5-b99b-e85a17a513fb. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG nova.network.neutron [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df9bc5d8-ad8f-4088-ba8c-8a1213bbac9b req-5b08ed12-ed35-4c28-9a68-34cb4112f210 service nova] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Creating config drive at /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config
Nov 14 03:31:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj3va1d96 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpj3va1d96" returned: 0 in 0.062s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] No waiting events found dispatching network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:24 user nova-compute[74836]: WARNING nova.compute.manager [req-08aef4a0-8b41-48d4-b2c4-51048aa3f096 req-77c21d7e-157e-4bde-a3df-a77bc0f4d256 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received unexpected event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b for instance with vm_state building and task_state spawning.
Nov 14 03:31:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] No waiting events found dispatching network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:26 user nova-compute[74836]: WARNING nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received unexpected event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 for instance with vm_state building and task_state spawning.
Nov 14 03:31:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] No waiting events found dispatching network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:26 user nova-compute[74836]: WARNING nova.compute.manager [req-93708b76-0d9a-4b32-803a-f1be8b51b645 req-f47d6b3e-3757-48f3-8a70-430d8017b5ac service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received unexpected event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 for instance with vm_state building and task_state spawning.
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] No waiting events found dispatching network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:27 user nova-compute[74836]: WARNING nova.compute.manager [req-820af708-0488-4d93-8fba-2b9e3c939ae6 req-dc9d1714-fc87-49fe-b096-213851cfa881 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received unexpected event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba for instance with vm_state active and task_state None.
Nov 14 03:31:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Instance spawned successfully.
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:28 user nova-compute[74836]: INFO nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Took 13.44 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:28 user nova-compute[74836]: INFO nova.compute.manager [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Took 15.44 seconds to build instance.
Nov 14 03:31:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0cb7a2cd-9e57-4265-a2de-04e3d84b9eb4 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.641s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Instance spawned successfully.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] No waiting events found dispatching network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:29 user nova-compute[74836]: WARNING nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received unexpected event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba for instance with vm_state active and task_state None.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:29 user nova-compute[74836]: WARNING nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state active and task_state None.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:29 user nova-compute[74836]: WARNING nova.compute.manager [req-e6d08716-1533-4eb3-8ace-1538dd1201e7 req-04f56345-c373-49cd-8105-d6fac3a2ddf7 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state active and task_state None.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: INFO nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Took 12.80 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:29 user nova-compute[74836]: INFO nova.compute.manager [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Took 14.99 seconds to build instance.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-58a381db-7b4a-4744-8200-1b1680fc7349 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.322s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Instance spawned successfully.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:29 user nova-compute[74836]: INFO nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Took 15.33 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Instance spawned successfully.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.compute.manager [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Took 16.62 seconds to build instance.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Instance spawned successfully.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9068b14a-63b2-49e6-9784-d4bb9389d4d5 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.885s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Took 11.83 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.compute.manager [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Took 13.09 seconds to build instance.
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Took 9.24 seconds to spawn the instance on the hypervisor.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:31:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-85d87cfa-d43a-469d-a5f3-f8c34e62eb97 tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.386s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:30 user nova-compute[74836]: INFO nova.compute.manager [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Took 10.51 seconds to build instance.
Nov 14 03:31:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-259e69fa-5609-48fe-9409-450a185e9e62 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.664s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] No waiting events found dispatching network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:34 user nova-compute[74836]: WARNING nova.compute.manager [req-13efbefd-17dc-40af-b1cc-a80fb6e2e2e2 req-9d8db4f9-44d2-428a-8e0b-2a9282cf266b service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received unexpected event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b for instance with vm_state active and task_state None.
Nov 14 03:31:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] No waiting events found dispatching network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:36 user nova-compute[74836]: WARNING nova.compute.manager [req-fc7f578f-eeb4-45eb-bc64-f5d53a53f661 req-ce223e9c-6274-4a8e-9e4f-0a7ae226a772 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received unexpected event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b for instance with vm_state active and task_state None.
Nov 14 03:31:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:31:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:31:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:31:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:31:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:43 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:44 user nova-compute[74836]: INFO nova.compute.claims [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Claim successful on node user
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:44 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG nova.policy [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fcef7c3b0e614a88a525e1206a3ac53a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be3568b751e74d52aca77712447c24f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.548s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:45 user nova-compute[74836]: INFO nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Booting with volume e3b0514c-8d96-4b37-a13e-ad64398d66fd at /dev/vda
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:31:46 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp2g6jjx48/privsep.sock']
Nov 14 03:31:46 user sudo[86067]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp2g6jjx48/privsep.sock
Nov 14 03:31:46 user sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully created port: 0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully created port: bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user sudo[86067]: pam_unix(sudo:session): session closed for user root
Nov 14 03:31:47 user nova-compute[74836]: INFO oslo.privsep.daemon [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Spawned new privsep daemon via rootwrap
Nov 14 03:31:47 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 03:31:47 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 03:31:47 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 03:31:47 user nova-compute[74836]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86110
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb8b13-9ec8-42c1-b136-1fb5a17e8d1c]: (2,) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8711a-db7a-44a6-b04a-e40428d7bdef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: WARNING os_brick.initiator.connectors.nvmeof [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[599994ff-3b99-4eea-a4cc-8b01e674ef57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8700be-4fa7-4843-9d43-566f0e2c36ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a868b41-6fd7-48ce-8f2c-7ac78513ecc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:47 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:31:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b904d07-0942-4c62-9b57-ea70d236b622]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== get_connector_properties: return (1908ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:31:47 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating existing volume attachment record: ff6ac7c5-c1e2-4778-ba9e-f88c211c148d {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully created port: 38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully created port: 22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7174MB free_disk=25.65270233154297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully created port: c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 685d82a2-1328-48ec-8899-4e8b103c969f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 93de60b4-700f-4284-a8d9-73130522d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f42731c4-27c7-47a6-9381-e8b3834cc027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:31:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: 0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.network.neutron [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.998s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.network.neutron [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: 0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-39d5b192-fefa-4095-80f3-2ef04ea0180a req-b31aadb4-2309-4eae-bd5d-60d828202d28 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:51 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:31:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: 6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-0809378c-740e-4637-a58b-e0d6e5c52c4b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:52 user nova-compute[74836]: INFO nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Booting with volume 1a96dddf-b801-480a-93a8-45422653c042 at /dev/vdb
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c4eb6-1f55-41ac-a551-5572d270d542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[55576a5a-c32d-4773-88d2-3430a027129e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-6167949d-685a-46f0-a68f-de0f066e79f6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38d529c-e4a8-46cf-96fd-01f502f4e4e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9aa90b-8f16-43c1-b376-e302510fba98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:52 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:31:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f1998-9ef6-4952-9033-020b6368769a]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating existing volume attachment record: afd5e6f9-f455-4242-9215-185897a24862 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:31:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-bace32eb-4e6b-422c-a453-036c5e1ed0ea. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: 38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e32479d2-57b4-4470-be7c-b048b1d006b9 req-18d5200f-df5d-4781-9e57-fe747618e918 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: 22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-38528097-e6d8-41f9-864b-9eb5651d0f78. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-22928474-efe9-42ba-8a68-196cf02cd7f6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-51decf61-663f-46d4-aa3e-982e9279396f req-a95149c1-0b97-4a15-8bf3-db3ae1d52709 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Successfully updated port: c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:31:55 user nova-compute[74836]: INFO nova.compute.claims [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Claim successful on node user
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-c79ef3d2-9a8d-45b5-8248-5d191c195299. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:31:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.policy [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ec46cf13af0439d87a512dc2d6f7baa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dce7b747694babbb43b8eb56ccfbf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:31:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Creating image(s)
Nov 14 03:31:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "/opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "/opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: INFO nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Booting with volume 315a61db-9282-467a-9582-eeabeae8ef48 at /dev/vdc
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk 1073741824" returned: 0 in 0.054s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28701ebd-090a-464e-8405-997f0dbbe2fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[860e20f7-f39c-41f4-855c-01ccfd77ed74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ada804-7348-4ea3-986c-f2a2a5af2cf5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[459c504b-9164-4993-81fd-433ce7d3095d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:31:57 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2b47a8-135c-4d36-9d36-019f70a9fcda]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG os_brick.utils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating existing volume attachment record: dde9ad7d-6fdf-424f-b856-f389726dd698 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Successfully created port: 487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Cannot resize image /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Ensure instance console log exists: /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Successfully updated port: 487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquired lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-changed-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Refreshing instance network info cache due to event network-changed-487e84e1-9a9b-4062-9795-c0c62c14749b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] Acquiring lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Updating instance_info_cache with network_info: [{"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Releasing lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Instance network_info: |[{"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] Acquired lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Refreshing network info cache for port 487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Start _get_guest_xml network_info=[{"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:31:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-44429210',display_name='tempest-VolumesNegativeTest-instance-44429210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-44429210',id=12,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59dce7b747694babbb43b8eb56ccfbf0',ramdisk_id='',reservation_id='r-xidi7pxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2020320353',owner_user_name='tempest-VolumesNegativeTest-2020320353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:57Z,user_data=None,user_id='1ec46cf13af0439d87a512dc2d6f7baa',uuid=cb43e386-c6cb-42bd-9793-c0e7ff22192e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converting VIF {"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lazy-loading 'pci_devices' on Instance uuid cb43e386-c6cb-42bd-9793-c0e7ff22192e {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:31:58 user nova-compute[74836]:   <uuid>cb43e386-c6cb-42bd-9793-c0e7ff22192e</uuid>
Nov 14 03:31:58 user nova-compute[74836]:   <name>instance-0000000c</name>
Nov 14 03:31:58 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:31:58 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:31:58 user nova-compute[74836]:   <metadata>
Nov 14 03:31:58 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:31:58 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:name>tempest-VolumesNegativeTest-instance-44429210</nova:name>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:31:58</nova:creationTime>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:31:58 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:31:58 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:owner>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:user uuid="1ec46cf13af0439d87a512dc2d6f7baa">tempest-VolumesNegativeTest-2020320353-project-member</nova:user>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:project uuid="59dce7b747694babbb43b8eb56ccfbf0">tempest-VolumesNegativeTest-2020320353</nova:project>
Nov 14 03:31:58 user nova-compute[74836]:       </nova:owner>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:31:58 user nova-compute[74836]:       <nova:ports>
Nov 14 03:31:58 user nova-compute[74836]:         <nova:port uuid="487e84e1-9a9b-4062-9795-c0c62c14749b">
Nov 14 03:31:58 user nova-compute[74836]:           <nova:ip type="fixed" address="192.168.233.20" ipVersion="4"/>
Nov 14 03:31:58 user nova-compute[74836]:         </nova:port>
Nov 14 03:31:58 user nova-compute[74836]:       </nova:ports>
Nov 14 03:31:58 user nova-compute[74836]:     </nova:instance>
Nov 14 03:31:58 user nova-compute[74836]:   </metadata>
Nov 14 03:31:58 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:31:58 user nova-compute[74836]:     <system>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="serial">cb43e386-c6cb-42bd-9793-c0e7ff22192e</entry>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="uuid">cb43e386-c6cb-42bd-9793-c0e7ff22192e</entry>
Nov 14 03:31:58 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:31:58 user nova-compute[74836]:     </system>
Nov 14 03:31:58 user nova-compute[74836]:   </sysinfo>
Nov 14 03:31:58 user nova-compute[74836]:   <os>
Nov 14 03:31:58 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:31:58 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:31:58 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:31:58 user nova-compute[74836]:   </os>
Nov 14 03:31:58 user nova-compute[74836]:   <features>
Nov 14 03:31:58 user nova-compute[74836]:     <acpi/>
Nov 14 03:31:58 user nova-compute[74836]:     <apic/>
Nov 14 03:31:58 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:31:58 user nova-compute[74836]:   </features>
Nov 14 03:31:58 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:31:58 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:31:58 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:31:58 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:31:58 user nova-compute[74836]:   </clock>
Nov 14 03:31:58 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:31:58 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:31:58 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:31:58 user nova-compute[74836]:   </cpu>
Nov 14 03:31:58 user nova-compute[74836]:   <devices>
Nov 14 03:31:58 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:31:58 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:31:58 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk"/>
Nov 14 03:31:58 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:31:58 user nova-compute[74836]:     </disk>
Nov 14 03:31:58 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:31:58 user nova-compute[74836]:       <mac address="fa:16:3e:2c:b3:13"/>
Nov 14 03:31:58 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:58 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:31:58 user nova-compute[74836]:       <target dev="tap487e84e1-9a"/>
Nov 14 03:31:58 user nova-compute[74836]:     </interface>
Nov 14 03:31:58 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:31:58 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/console.log" append="off"/>
Nov 14 03:31:58 user nova-compute[74836]:     </serial>
Nov 14 03:31:58 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:31:58 user nova-compute[74836]:     <video>
Nov 14 03:31:58 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:31:58 user nova-compute[74836]:     </video>
Nov 14 03:31:58 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:31:58 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:31:58 user nova-compute[74836]:     </rng>
Nov 14 03:31:58 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:31:58 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:31:58 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:31:58 user nova-compute[74836]:     </memballoon>
Nov 14 03:31:58 user nova-compute[74836]:   </devices>
Nov 14 03:31:58 user nova-compute[74836]: </domain>
Nov 14 03:31:58 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-44429210',display_name='tempest-VolumesNegativeTest-instance-44429210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-44429210',id=12,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59dce7b747694babbb43b8eb56ccfbf0',ramdisk_id='',reservation_id='r-xidi7pxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2020320353',owner_user_name='tempest-VolumesNegativeTest-2020320353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:57Z,user_data=None,user_id='1ec46cf13af0439d87a512dc2d6f7baa',uuid=cb43e386-c6cb-42bd-9793-c0e7ff22192e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converting VIF {"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG os_vif [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ffc5aa8-b520-5c01-bfb7-7ed8c7135b9a', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap487e84e1-9a, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap487e84e1-9a, col_values=(('qos', UUID('2edb4dec-3356-47fc-a856-39026346bd10')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap487e84e1-9a, col_values=(('external_ids', {'iface-id': '487e84e1-9a9b-4062-9795-c0c62c14749b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:b3:13', 'vm-uuid': 'cb43e386-c6cb-42bd-9793-c0e7ff22192e'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:31:58 user nova-compute[74836]: INFO os_vif [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a')
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] No VIF found with MAC fa:16:3e:2c:b3:13, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] No waiting events found dispatching network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:31:58 user nova-compute[74836]: WARNING nova.compute.manager [req-5c50c6fb-545e-4b94-9d7a-3663fdb8d55c req-f79c5025-1c0f-4a09-a692-5c8e20047aba service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received unexpected event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 for instance with vm_state active and task_state None.
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Updated VIF entry in instance network info cache for port 487e84e1-9a9b-4062-9795-c0c62c14749b. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Updating instance_info_cache with network_info: [{"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c60a783-7485-4623-bde8-168fc7cf5ba1 req-3fce0539-591e-4cfd-8d96-3c409a98d0ba service nova] Releasing lock "refresh_cache-cb43e386-c6cb-42bd-9793-c0e7ff22192e" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance network_info: |[{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updated VIF entry in instance network info cache for port c79ef3d2-9a8d-45b5-8248-5d191c195299. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:31:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd0956ea-80e3-46ea-ab0c-22252068ed6b req-e201f1ac-49d7-4e40-9f64-e9304667a842 service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] No waiting events found dispatching network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received unexpected event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 for instance with vm_state active and task_state None.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] No waiting events found dispatching network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received unexpected event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 for instance with vm_state active and task_state None.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] No waiting events found dispatching network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received unexpected event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 for instance with vm_state active and task_state None.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb for instance with vm_state active and task_state None.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-plugged-c2f23a72-6538-48c5-b99b-e85a17a513fb for instance with vm_state active and task_state None.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] No waiting events found dispatching network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received unexpected event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b for instance with vm_state building and task_state spawning.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] No waiting events found dispatching network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:00 user nova-compute[74836]: WARNING nova.compute.manager [req-7b64df39-f383-4a23-a7f3-415cddb8b369 req-3d8f7514-67ee-4ec7-9452-d92b93fd4744 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received unexpected event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b for instance with vm_state building and task_state spawning.
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:32:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Creating image(s)
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Ensure instance console log exists: /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Start _get_guest_xml network_info=[{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFWMJjAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f42731c4-27c7-47a6-9381-e8b3834cc027', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3b0514c-8d96-4b37-a13e-ad64398d66fd', 'serial': 'e3b0514c-8d96-4b37-a13e-ad64398d66fd'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'ff6ac7c5-c1e2-4778-ba9e-f88c211c148d', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyfxOwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f42731c4-27c7-47a6-9381-e8b3834cc027', 'attached_at': '', 'detached_at': '', 'volume_id': '1a96dddf-b801-480a-93a8-45422653c042', 'serial': '1a96dddf-b801-480a-93a8-45422653c042'}, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'afd5e6f9-f455-4242-9215-185897a24862', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtaSXZck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f42731c4-27c7-47a6-9381-e8b3834cc027', 'attached_at': '', 'detached_at': '', 'volume_id': '315a61db-9282-467a-9582-eeabeae8ef48', 'serial': '315a61db-9282-467a-9582-eeabeae8ef48'}, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'dde9ad7d-6fdf-424f-b856-f389726dd698', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:32:02 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:02 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connector [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Factory for ISCSI on None {{(pid=74836) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFWMJjAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:32:02 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:02 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:02 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c102e46-6a52-4b01-8a2f-8a28bfd99f14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:32:02 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c318f10-85cc-4420-91f7-08bc6e9e5f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd] added
Nov 14 03:32:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d9930e-630d-4ac1-ac8f-e52cb4b2b407]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d693a4-8b14-4530-88ff-da4b72888fa4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFWMJjAa {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EFWMJjAa" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b82cf29-9735-4ae1-9f87-f76d4f80238b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EFWMJjAa'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96db68c-de38-432e-a9c2-d75cbf8821d1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530068a-d512-4c4e-a328-d5a26295ca54]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:32:02 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:32:02 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:02 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 03:32:02 user nova-compute[74836]: 
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[614fdfe0-7063-47e7-8674-2ed1cd385a52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260]
Nov 14 03:32:02 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260] successful.
Nov 14 03:32:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7fcc6b-52e7-430d-b177-eacbf250185a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ae24f2-a976-4b04-be24-7241f2b31538]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0c2ff-8f96-4665-a8aa-22336933af87]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFWMJjAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:32:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Instance spawned successfully.
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:02 user nova-compute[74836]: INFO nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 14 03:32:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:02 user nova-compute[74836]: INFO nova.compute.manager [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Took 6.92 seconds to build instance.
Nov 14 03:32:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2fd8068c-eff7-423b-8f9e-e190f8fd63bc tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26232633932643935', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232633932643935', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyfxOwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:32:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:03 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11631659-fc02-466d-a319-664235052ffe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:32:03 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caed583-eadf-4b2b-8eb9-8bb065b05a37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042] added
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73a900b-d12a-42ab-b91f-67a4c5d2d305]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead999d-3e87-4c63-a763-b3c214fe9701]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMyfxOwJ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zMyfxOwJ" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[98769a18-28d2-4d26-b268-bdacb24081e8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zMyfxOwJ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6774a2ed-5c40-4f62-8055-82bde476c6c6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e8abf-b908-4ba8-b439-d88c31fe86eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93bdbbb-bc09-4211-82bd-dd24052c1cc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260]
Nov 14 03:32:03 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260] successful.
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdee921c-139f-45c8-85c3-6d42cf63542e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3509a69-dd2b-4c0c-81a3-38c6843f7e2e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:03 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:03 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[63970ab4-e94d-43cf-b20e-26d884c2ed96]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:32:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyfxOwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26661343235353763', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661343235353763', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtaSXZck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:32:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:32:04 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5383a718-fe9c-4e2a-9a24-6d4b02c8367a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:32:04 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1d5a7f-f254-4962-82d1-b3480c163eed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48] added
Nov 14 03:32:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8057f0a-3814-4196-a6fb-74ea68772dd1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8e9f55-a9eb-48bc-98e0-976c9a2bc55a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtaSXZck {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EtaSXZck" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc993b3e-8bd2-4c1d-8718-932d378dcee9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EtaSXZck'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c4ae8f-227a-498d-a061-494b2ed78713]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aadb2c7-a5a5-47eb-954b-318593a78305]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d5adff-d311-46b7-959b-86dfefdd7c22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260]
Nov 14 03:32:05 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260] successful.
Nov 14 03:32:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8441364e-45cc-4914-81cc-fc418d72210b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4584ab1b-c695-4f3a-a69e-e508602f86f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:32:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f84a0-0326-4d6d-b09c-b3fd9ae67ba0]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:32:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtaSXZck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23864366237663435', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864366237663435', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.objects.instance [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lazy-loading 'pci_devices' on Instance uuid f42731c4-27c7-47a6-9381-e8b3834cc027 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:32:06 user nova-compute[74836]:   <uuid>f42731c4-27c7-47a6-9381-e8b3834cc027</uuid>
Nov 14 03:32:06 user nova-compute[74836]:   <name>instance-0000000b</name>
Nov 14 03:32:06 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:32:06 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:32:06 user nova-compute[74836]:   <metadata>
Nov 14 03:32:06 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:32:06 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:name>tempest-device-tagging-server-1285768368</nova:name>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:32:02</nova:creationTime>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:32:06 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:32:06 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:owner>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:user uuid="fcef7c3b0e614a88a525e1206a3ac53a">tempest-TaggedBootDevicesTest_v242-625165495-project-member</nova:user>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:project uuid="be3568b751e74d52aca77712447c24f8">tempest-TaggedBootDevicesTest_v242-625165495</nova:project>
Nov 14 03:32:06 user nova-compute[74836]:       </nova:owner>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:32:06 user nova-compute[74836]:       <nova:ports>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="0ed713d4-0000-4c32-a8ad-ea5123b2fbdc">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="0809378c-740e-4637-a58b-e0d6e5c52c4b">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="6167949d-685a-46f0-a68f-de0f066e79f6">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="bace32eb-4e6b-422c-a453-036c5e1ed0ea">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.245" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="38528097-e6d8-41f9-864b-9eb5651d0f78">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="22928474-efe9-42ba-8a68-196cf02cd7f6">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:         <nova:port uuid="c79ef3d2-9a8d-45b5-8248-5d191c195299">
Nov 14 03:32:06 user nova-compute[74836]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 03:32:06 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:06 user nova-compute[74836]:       </nova:ports>
Nov 14 03:32:06 user nova-compute[74836]:     </nova:instance>
Nov 14 03:32:06 user nova-compute[74836]:   </metadata>
Nov 14 03:32:06 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:32:06 user nova-compute[74836]:     <system>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="serial">f42731c4-27c7-47a6-9381-e8b3834cc027</entry>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="uuid">f42731c4-27c7-47a6-9381-e8b3834cc027</entry>
Nov 14 03:32:06 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:32:06 user nova-compute[74836]:     </system>
Nov 14 03:32:06 user nova-compute[74836]:   </sysinfo>
Nov 14 03:32:06 user nova-compute[74836]:   <os>
Nov 14 03:32:06 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:32:06 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:32:06 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:32:06 user nova-compute[74836]:   </os>
Nov 14 03:32:06 user nova-compute[74836]:   <features>
Nov 14 03:32:06 user nova-compute[74836]:     <acpi/>
Nov 14 03:32:06 user nova-compute[74836]:     <apic/>
Nov 14 03:32:06 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:32:06 user nova-compute[74836]:   </features>
Nov 14 03:32:06 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:32:06 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:32:06 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:32:06 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:32:06 user nova-compute[74836]:   </clock>
Nov 14 03:32:06 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:32:06 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:32:06 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:32:06 user nova-compute[74836]:   </cpu>
Nov 14 03:32:06 user nova-compute[74836]:   <devices>
Nov 14 03:32:06 user nova-compute[74836]:     <disk type="file" device="cdrom">
Nov 14 03:32:06 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 03:32:06 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/disk.config"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="hda" bus="ide"/>
Nov 14 03:32:06 user nova-compute[74836]:     </disk>
Nov 14 03:32:06 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:32:06 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:32:06 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <serial>e3b0514c-8d96-4b37-a13e-ad64398d66fd</serial>
Nov 14 03:32:06 user nova-compute[74836]:     </disk>
Nov 14 03:32:06 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:32:06 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:32:06 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <serial>1a96dddf-b801-480a-93a8-45422653c042</serial>
Nov 14 03:32:06 user nova-compute[74836]:     </disk>
Nov 14 03:32:06 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:32:06 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:32:06 user nova-compute[74836]:       <source dev="/dev/sdd"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="vdc" bus="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <serial>315a61db-9282-467a-9582-eeabeae8ef48</serial>
Nov 14 03:32:06 user nova-compute[74836]:     </disk>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:fe:ab:35"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tap0ed713d4-00"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:29:b6:97"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tap0809378c-74"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:93:b0:99"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tap6167949d-68"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:19:8c:f0"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tapbace32eb-4e"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:d5:2d:c0"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tap38528097-e6"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:cd:d3:e9"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tap22928474-ef"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:06 user nova-compute[74836]:       <mac address="fa:16:3e:10:1f:cc"/>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:06 user nova-compute[74836]:       <target dev="tapc79ef3d2-9a"/>
Nov 14 03:32:06 user nova-compute[74836]:     </interface>
Nov 14 03:32:06 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:32:06 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/console.log" append="off"/>
Nov 14 03:32:06 user nova-compute[74836]:     </serial>
Nov 14 03:32:06 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:32:06 user nova-compute[74836]:     <video>
Nov 14 03:32:06 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:06 user nova-compute[74836]:     </video>
Nov 14 03:32:06 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:32:06 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:32:06 user nova-compute[74836]:     </rng>
Nov 14 03:32:06 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:32:06 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:32:06 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:32:06 user nova-compute[74836]:     </memballoon>
Nov 14 03:32:06 user nova-compute[74836]:   </devices>
Nov 14 03:32:06 user nova-compute[74836]: </domain>
Nov 14 03:32:06 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29e71fcf-8b41-54b6-9a61-cc8cb3a5f60a', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ed713d4-00, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ed713d4-00, col_values=(('qos', UUID('84ea9ffe-7a28-4232-839b-0fb18c7f722e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ed713d4-00, col_values=(('external_ids', {'iface-id': '0ed713d4-0000-4c32-a8ad-ea5123b2fbdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ab:35', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11999493-c652-5823-8383-2dd3c6827071', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0809378c-74, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0809378c-74, col_values=(('qos', UUID('dd0589a6-a748-4e2c-a61a-c89a347ae881')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0809378c-74, col_values=(('external_ids', {'iface-id': '0809378c-740e-4637-a58b-e0d6e5c52c4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:b6:97', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30d2317d-aab5-5ff0-926e-fc9f336d471a', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6167949d-68, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6167949d-68, col_values=(('qos', UUID('31369fbf-c1e3-4e50-bc8c-ed8bbe69fd1a')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6167949d-68, col_values=(('external_ids', {'iface-id': '6167949d-685a-46f0-a68f-de0f066e79f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:b0:99', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bf40a29-876b-5c3b-b281-931e31084ed6', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbace32eb-4e, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbace32eb-4e, col_values=(('qos', UUID('963c2ab2-7d64-423b-9be5-e5b4964b7e61')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbace32eb-4e, col_values=(('external_ids', {'iface-id': 'bace32eb-4e6b-422c-a453-036c5e1ed0ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:8c:f0', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4210391-d7a8-5145-8f88-b3469b95f2de', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38528097-e6, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38528097-e6, col_values=(('qos', UUID('24147da0-aeb0-4d8c-9166-ed3dc9a3b16f')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38528097-e6, col_values=(('external_ids', {'iface-id': '38528097-e6d8-41f9-864b-9eb5651d0f78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:2d:c0', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '967f3861-f3de-5857-b9d3-b66354e10678', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22928474-ef, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22928474-ef, col_values=(('qos', UUID('001fdb61-797a-4e12-b5de-3c91d00c91b1')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22928474-ef, col_values=(('external_ids', {'iface-id': '22928474-efe9-42ba-8a68-196cf02cd7f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:d3:e9', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce98808a-d424-50e1-b292-2fe8b7fbc822', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc79ef3d2-9a, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc79ef3d2-9a, col_values=(('qos', UUID('ecb214e5-f413-4631-b92b-ba473d653ca1')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc79ef3d2-9a, col_values=(('external_ids', {'iface-id': 'c79ef3d2-9a8d-45b5-8248-5d191c195299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:1f:cc', 'vm-uuid': 'f42731c4-27c7-47a6-9381-e8b3834cc027'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:06 user nova-compute[74836]: INFO os_vif [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a')
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] No BDM found with device name hda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] No VIF found with MAC fa:16:3e:fe:ab:35, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:32:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] No VIF found with MAC fa:16:3e:d5:2d:c0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:32:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Using config drive
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:32:07 user nova-compute[74836]: INFO nova.compute.claims [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Claim successful on node user
Nov 14 03:32:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Creating config drive at /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/disk.config
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_t9tv0u9 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_t9tv0u9" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:32:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.policy [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7460cb84c194287b1bcbf512bd98ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c60d13f8c14f9a9849ba536a716032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:32:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Creating image(s)
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Successfully created port: db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG nova.virt.images [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ce8c25fb-ee6b-4f80-b055-86191a9c8143 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.part /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.part /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.converted" returned: 0 in 0.151s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.052s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Successfully updated port: db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing instance network info cache due to event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json" returned: 0 in 0.199s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5,backing_fmt=raw /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5,backing_fmt=raw /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk 1073741824" returned: 0 in 0.045s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "f42ee1441edbf2c150c4c8df95ca735c8502ede5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:09 user nova-compute[74836]: WARNING nova.compute.manager [req-ad2ee688-7ef3-469d-a781-831aaf3aabce req-30c3e0e3-7c4c-4487-afb0-b060d3bc8e32 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b for instance with vm_state building and task_state spawning.
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Cannot resize image /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Ensure instance console log exists: /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance network_info: |[{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start _get_guest_xml network_info=[{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:32:04Z,direct_url=<?>,disk_format='qcow2',id=ce8c25fb-ee6b-4f80-b055-86191a9c8143,min_disk=0,min_ram=0,name='tempest-scenario-img--1119006215',owner='a2c60d13f8c14f9a9849ba536a716032',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:32:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': 'ce8c25fb-ee6b-4f80-b055-86191a9c8143'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:32:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:32:04Z,direct_url=<?>,disk_format='qcow2',id=ce8c25fb-ee6b-4f80-b055-86191a9c8143,min_disk=0,min_ram=0,name='tempest-scenario-img--1119006215',owner='a2c60d13f8c14f9a9849ba536a716032',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:32:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:32:08Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.objects.instance [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'pci_devices' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:32:09 user nova-compute[74836]:   <uuid>511e8759-a397-4300-9925-6fdf53a1631d</uuid>
Nov 14 03:32:09 user nova-compute[74836]:   <name>instance-0000000d</name>
Nov 14 03:32:09 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:32:09 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:32:09 user nova-compute[74836]:   <metadata>
Nov 14 03:32:09 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:32:09 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:name>tempest-TestMinimumBasicScenario-server-1817550384</nova:name>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:32:09</nova:creationTime>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:32:09 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:32:09 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:owner>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:user uuid="f7460cb84c194287b1bcbf512bd98ff5">tempest-TestMinimumBasicScenario-84832661-project-member</nova:user>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:project uuid="a2c60d13f8c14f9a9849ba536a716032">tempest-TestMinimumBasicScenario-84832661</nova:project>
Nov 14 03:32:09 user nova-compute[74836]:       </nova:owner>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:root type="image" uuid="ce8c25fb-ee6b-4f80-b055-86191a9c8143"/>
Nov 14 03:32:09 user nova-compute[74836]:       <nova:ports>
Nov 14 03:32:09 user nova-compute[74836]:         <nova:port uuid="db74e63c-4b75-41e6-bcb2-20955d2e6da4">
Nov 14 03:32:09 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:32:09 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:09 user nova-compute[74836]:       </nova:ports>
Nov 14 03:32:09 user nova-compute[74836]:     </nova:instance>
Nov 14 03:32:09 user nova-compute[74836]:   </metadata>
Nov 14 03:32:09 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:32:09 user nova-compute[74836]:     <system>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="serial">511e8759-a397-4300-9925-6fdf53a1631d</entry>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="uuid">511e8759-a397-4300-9925-6fdf53a1631d</entry>
Nov 14 03:32:09 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:32:09 user nova-compute[74836]:     </system>
Nov 14 03:32:09 user nova-compute[74836]:   </sysinfo>
Nov 14 03:32:09 user nova-compute[74836]:   <os>
Nov 14 03:32:09 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:32:09 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:32:09 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:32:09 user nova-compute[74836]:   </os>
Nov 14 03:32:09 user nova-compute[74836]:   <features>
Nov 14 03:32:09 user nova-compute[74836]:     <acpi/>
Nov 14 03:32:09 user nova-compute[74836]:     <apic/>
Nov 14 03:32:09 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:32:09 user nova-compute[74836]:   </features>
Nov 14 03:32:09 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:32:09 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:32:09 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:32:09 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:32:09 user nova-compute[74836]:   </clock>
Nov 14 03:32:09 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:32:09 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:32:09 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:32:09 user nova-compute[74836]:   </cpu>
Nov 14 03:32:09 user nova-compute[74836]:   <devices>
Nov 14 03:32:09 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:32:09 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:32:09 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk"/>
Nov 14 03:32:09 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:32:09 user nova-compute[74836]:     </disk>
Nov 14 03:32:09 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:09 user nova-compute[74836]:       <mac address="fa:16:3e:2f:96:1b"/>
Nov 14 03:32:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:09 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:09 user nova-compute[74836]:       <target dev="tapdb74e63c-4b"/>
Nov 14 03:32:09 user nova-compute[74836]:     </interface>
Nov 14 03:32:09 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:32:09 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/console.log" append="off"/>
Nov 14 03:32:09 user nova-compute[74836]:     </serial>
Nov 14 03:32:09 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:32:09 user nova-compute[74836]:     <video>
Nov 14 03:32:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:09 user nova-compute[74836]:     </video>
Nov 14 03:32:09 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:32:09 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:32:09 user nova-compute[74836]:     </rng>
Nov 14 03:32:09 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:32:09 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:32:09 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:32:09 user nova-compute[74836]:     </memballoon>
Nov 14 03:32:09 user nova-compute[74836]:   </devices>
Nov 14 03:32:09 user nova-compute[74836]: </domain>
Nov 14 03:32:09 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:32:08Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG os_vif [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fce4cd7c-d9a6-5b60-b0cc-2f5e484cd61d', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb74e63c-4b, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb74e63c-4b, col_values=(('qos', UUID('306226af-ae82-4b58-b579-9518a2f4180e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb74e63c-4b, col_values=(('external_ids', {'iface-id': 'db74e63c-4b75-41e6-bcb2-20955d2e6da4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:96:1b', 'vm-uuid': '511e8759-a397-4300-9925-6fdf53a1631d'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: INFO os_vif [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b')
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No VIF found with MAC fa:16:3e:2f:96:1b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updated VIF entry in instance network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-621bec01-e075-47cf-b133-0897bd49076c req-ba7ad187-92a4-488f-8642-6c01e692d59b service nova] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d1ef7042-519e-413a-8072-7960b2baabf2 req-c2f6478a-fbb4-49d2-ad21-2e5f6b98a781 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-9f7f3762-d40d-481d-a9ed-a0d0232bca94 req-b5636068-305f-4ad5-8a9e-65b42ef51ee8 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea for instance with vm_state building and task_state spawning.
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:11 user nova-compute[74836]: WARNING nova.compute.manager [req-761d1e7e-e0bb-463f-a050-458307b35f38 req-c390bd38-392c-43dd-9636-766b8b70f191 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea for instance with vm_state building and task_state spawning.
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:13 user nova-compute[74836]: WARNING nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state building and task_state spawning.
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:13 user nova-compute[74836]: WARNING nova.compute.manager [req-06fe35f0-f57b-4510-82d2-fa2037d4b3b9 req-7eff66bd-4e13-428b-b725-6f7c62a33912 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state building and task_state spawning.
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:13 user nova-compute[74836]: WARNING nova.compute.manager [req-813d0647-b2fa-42c4-81b2-e4d5205ec8de req-d42896f9-2af2-468e-8085-29bcc1b9e849 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 for instance with vm_state building and task_state spawning.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance spawned successfully.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance spawned successfully.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Took 12.69 seconds to spawn the instance on the hypervisor.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.compute.manager [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Took 30.77 seconds to build instance.
Nov 14 03:32:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-639f9304-f2c7-48d8-9925-20fb8136daa7 tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.947s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:14 user nova-compute[74836]: INFO nova.compute.manager [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Took 7.92 seconds to build instance.
Nov 14 03:32:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-99c5b4b4-949a-4617-8e46-bd622489e4ce tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.005s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:35 user nova-compute[74836]: INFO nova.compute.manager [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Rescuing
Nov 14 03:32:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:36 user nova-compute[74836]: INFO nova.compute.manager [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] instance snapshotting
Nov 14 03:32:36 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Beginning live snapshot process
Nov 14 03:32:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:36 user nova-compute[74836]: WARNING nova.compute.manager [req-f7253b92-38ec-4a83-b2e0-844d12b6e795 req-282f7e83-75bd-42ef-9af7-fd1f0fbae16e service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state active and task_state rescuing.
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.221s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314.delta 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314.delta 1073741824" returned: 0 in 0.059s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74836) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.host [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] UEFI support detected
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance destroyed successfully.
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Attempting rescue
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Creating image(s)
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue" returned: 0 in 0.076s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'migration_context' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.base [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<2a266da1-3823-4ae8-b45c-17c1b7543a5a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start _get_guest_xml network_info=[{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:48:37:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.base [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<2a266da1-3823-4ae8-b45c-17c1b7543a5a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'numa_topology' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.base [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<2a266da1-3823-4ae8-b45c-17c1b7543a5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:32:37 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:37 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.base [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<2a266da1-3823-4ae8-b45c-17c1b7543a5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-424831790',display_name='tempest-ServerRescueNegativeTestJSON-server-424831790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-424831790',id=3,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-2030xd1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:01Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=2a266da1-3823-4ae8-b45c-17c1b7543a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:48:37:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:48:37:d9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.objects.base [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<2a266da1-3823-4ae8-b45c-17c1b7543a5a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:32:37 user nova-compute[74836]:   <uuid>2a266da1-3823-4ae8-b45c-17c1b7543a5a</uuid>
Nov 14 03:32:37 user nova-compute[74836]:   <name>instance-00000003</name>
Nov 14 03:32:37 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:32:37 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:32:37 user nova-compute[74836]:   <metadata>
Nov 14 03:32:37 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:32:37 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-424831790</nova:name>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:32:37</nova:creationTime>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:32:37 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:32:37 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:owner>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:32:37 user nova-compute[74836]:       </nova:owner>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:32:37 user nova-compute[74836]:       <nova:ports>
Nov 14 03:32:37 user nova-compute[74836]:         <nova:port uuid="6561cb21-a719-4b80-b0fc-1c6d2e2de49a">
Nov 14 03:32:37 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 03:32:37 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:37 user nova-compute[74836]:       </nova:ports>
Nov 14 03:32:37 user nova-compute[74836]:     </nova:instance>
Nov 14 03:32:37 user nova-compute[74836]:   </metadata>
Nov 14 03:32:37 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:32:37 user nova-compute[74836]:     <system>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="serial">2a266da1-3823-4ae8-b45c-17c1b7543a5a</entry>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="uuid">2a266da1-3823-4ae8-b45c-17c1b7543a5a</entry>
Nov 14 03:32:37 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:32:37 user nova-compute[74836]:     </system>
Nov 14 03:32:37 user nova-compute[74836]:   </sysinfo>
Nov 14 03:32:37 user nova-compute[74836]:   <os>
Nov 14 03:32:37 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:32:37 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:32:37 user nova-compute[74836]:   </os>
Nov 14 03:32:37 user nova-compute[74836]:   <features>
Nov 14 03:32:37 user nova-compute[74836]:     <acpi/>
Nov 14 03:32:37 user nova-compute[74836]:     <apic/>
Nov 14 03:32:37 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:32:37 user nova-compute[74836]:   </features>
Nov 14 03:32:37 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:32:37 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:32:37 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:32:37 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:32:37 user nova-compute[74836]:   </clock>
Nov 14 03:32:37 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:32:37 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:32:37 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:32:37 user nova-compute[74836]:   </cpu>
Nov 14 03:32:37 user nova-compute[74836]:   <devices>
Nov 14 03:32:37 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:32:37 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:32:37 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue"/>
Nov 14 03:32:37 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:32:37 user nova-compute[74836]:     </disk>
Nov 14 03:32:37 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:32:37 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:32:37 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk"/>
Nov 14 03:32:37 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:32:37 user nova-compute[74836]:     </disk>
Nov 14 03:32:37 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:37 user nova-compute[74836]:       <mac address="fa:16:3e:48:37:d9"/>
Nov 14 03:32:37 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:37 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:37 user nova-compute[74836]:       <target dev="tap6561cb21-a7"/>
Nov 14 03:32:37 user nova-compute[74836]:     </interface>
Nov 14 03:32:37 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:32:37 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/console.log" append="off"/>
Nov 14 03:32:37 user nova-compute[74836]:     </serial>
Nov 14 03:32:37 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:32:37 user nova-compute[74836]:     <video>
Nov 14 03:32:37 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:37 user nova-compute[74836]:     </video>
Nov 14 03:32:37 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:32:37 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:32:37 user nova-compute[74836]:     </rng>
Nov 14 03:32:37 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:32:37 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:32:37 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:32:37 user nova-compute[74836]:     </memballoon>
Nov 14 03:32:37 user nova-compute[74836]:   </devices>
Nov 14 03:32:37 user nova-compute[74836]: </domain>
Nov 14 03:32:37 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:32:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance destroyed successfully.
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:48:37:d9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:32:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] COPY block job progress, current cursor: 393216 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:32:38 user nova-compute[74836]: INFO nova.compute.claims [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Claim successful on node user
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:32:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314.delta /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:38 user nova-compute[74836]: WARNING nova.compute.manager [req-cc19371f-617c-484a-85bb-e88b57fd7805 req-f2d5c444-f949-477b-9fb3-c7bb867d8cef service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state active and task_state rescuing.
Nov 14 03:32:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.701s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.policy [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ab86e22169934541aaf5599c215eb601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '300a5c30444b4f93be44cc7580991dc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:32:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314.delta /opt/stack/data/nova/instances/snapshots/tmpgmt_e9ns/a17677f8f668479f88a592e53094e314" returned: 0 in 0.464s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Snapshot extracted, beginning image upload
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:32:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Creating image(s)
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "/opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "/opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "/opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Successfully created port: 555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk 1073741824" returned: 0 in 0.062s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:32:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Cannot resize image /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Ensure instance console log exists: /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Successfully updated port: 555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquired lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-changed-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Refreshing instance network info cache due to event network-changed-555e29fa-7e6c-45e5-ad95-f8d062d53e09. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] Acquiring lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Updating instance_info_cache with network_info: [{"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Releasing lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Instance network_info: |[{"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] Acquired lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.neutron [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Refreshing network info cache for port 555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Start _get_guest_xml network_info=[{"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:32:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1901248885',display_name='tempest-ServersNegativeTestJSON-server-1901248885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1901248885',id=14,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-hofkc9l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:32:39Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=28e19196-80cc-4f64-9444-546a29180fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e19196-80cc-4f64-9444-546a29180fb4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:32:40 user nova-compute[74836]:   <uuid>28e19196-80cc-4f64-9444-546a29180fb4</uuid>
Nov 14 03:32:40 user nova-compute[74836]:   <name>instance-0000000e</name>
Nov 14 03:32:40 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:32:40 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:32:40 user nova-compute[74836]:   <metadata>
Nov 14 03:32:40 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:32:40 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:name>tempest-ServersNegativeTestJSON-server-1901248885</nova:name>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:32:40</nova:creationTime>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:32:40 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:32:40 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:owner>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:user uuid="ab86e22169934541aaf5599c215eb601">tempest-ServersNegativeTestJSON-1971360444-project-member</nova:user>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:project uuid="300a5c30444b4f93be44cc7580991dc4">tempest-ServersNegativeTestJSON-1971360444</nova:project>
Nov 14 03:32:40 user nova-compute[74836]:       </nova:owner>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:32:40 user nova-compute[74836]:       <nova:ports>
Nov 14 03:32:40 user nova-compute[74836]:         <nova:port uuid="555e29fa-7e6c-45e5-ad95-f8d062d53e09">
Nov 14 03:32:40 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:32:40 user nova-compute[74836]:         </nova:port>
Nov 14 03:32:40 user nova-compute[74836]:       </nova:ports>
Nov 14 03:32:40 user nova-compute[74836]:     </nova:instance>
Nov 14 03:32:40 user nova-compute[74836]:   </metadata>
Nov 14 03:32:40 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:32:40 user nova-compute[74836]:     <system>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="serial">28e19196-80cc-4f64-9444-546a29180fb4</entry>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="uuid">28e19196-80cc-4f64-9444-546a29180fb4</entry>
Nov 14 03:32:40 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:32:40 user nova-compute[74836]:     </system>
Nov 14 03:32:40 user nova-compute[74836]:   </sysinfo>
Nov 14 03:32:40 user nova-compute[74836]:   <os>
Nov 14 03:32:40 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:32:40 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:32:40 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:32:40 user nova-compute[74836]:   </os>
Nov 14 03:32:40 user nova-compute[74836]:   <features>
Nov 14 03:32:40 user nova-compute[74836]:     <acpi/>
Nov 14 03:32:40 user nova-compute[74836]:     <apic/>
Nov 14 03:32:40 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:32:40 user nova-compute[74836]:   </features>
Nov 14 03:32:40 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:32:40 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:32:40 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:32:40 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:32:40 user nova-compute[74836]:   </clock>
Nov 14 03:32:40 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:32:40 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:32:40 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:32:40 user nova-compute[74836]:   </cpu>
Nov 14 03:32:40 user nova-compute[74836]:   <devices>
Nov 14 03:32:40 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:32:40 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:32:40 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk"/>
Nov 14 03:32:40 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:32:40 user nova-compute[74836]:     </disk>
Nov 14 03:32:40 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:32:40 user nova-compute[74836]:       <mac address="fa:16:3e:25:f4:6b"/>
Nov 14 03:32:40 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:40 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:32:40 user nova-compute[74836]:       <target dev="tap555e29fa-7e"/>
Nov 14 03:32:40 user nova-compute[74836]:     </interface>
Nov 14 03:32:40 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:32:40 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/console.log" append="off"/>
Nov 14 03:32:40 user nova-compute[74836]:     </serial>
Nov 14 03:32:40 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:32:40 user nova-compute[74836]:     <video>
Nov 14 03:32:40 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:32:40 user nova-compute[74836]:     </video>
Nov 14 03:32:40 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:32:40 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:32:40 user nova-compute[74836]:     </rng>
Nov 14 03:32:40 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:32:40 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:32:40 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:32:40 user nova-compute[74836]:     </memballoon>
Nov 14 03:32:40 user nova-compute[74836]:   </devices>
Nov 14 03:32:40 user nova-compute[74836]: </domain>
Nov 14 03:32:40 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1901248885',display_name='tempest-ServersNegativeTestJSON-server-1901248885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1901248885',id=14,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-hofkc9l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:32:39Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=28e19196-80cc-4f64-9444-546a29180fb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG os_vif [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a71a32d1-5035-5b4d-9712-a3e7580da01e', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap555e29fa-7e, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap555e29fa-7e, col_values=(('qos', UUID('5ea49a41-409c-40ec-ba00-3524945485f1')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap555e29fa-7e, col_values=(('external_ids', {'iface-id': '555e29fa-7e6c-45e5-ad95-f8d062d53e09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:f4:6b', 'vm-uuid': '28e19196-80cc-4f64-9444-546a29180fb4'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:40 user nova-compute[74836]: WARNING nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state active and task_state rescuing.
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:40 user nova-compute[74836]: WARNING nova.compute.manager [req-700bf5d7-9890-4fc2-add2-60f53325427a req-8b66f61a-2a0f-463a-a157-f25ead8353f2 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state active and task_state rescuing.
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:40 user nova-compute[74836]: INFO os_vif [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e')
Nov 14 03:32:40 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:32:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] No VIF found with MAC fa:16:3e:25:f4:6b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:32:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Updated VIF entry in instance network info cache for port 555e29fa-7e6c-45e5-ad95-f8d062d53e09. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:32:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Updating instance_info_cache with network_info: [{"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5efb52a0-04de-4cbe-806a-32df1f1d26fc req-308a38c2-7734-46ec-9ceb-68468e98d66b service nova] Releasing lock "refresh_cache-28e19196-80cc-4f64-9444-546a29180fb4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a4d9d36c-50a3-41b1-9249-b272e068afb4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Snapshot image upload complete
Nov 14 03:32:41 user nova-compute[74836]: INFO nova.compute.manager [None req-7f1a9fdb-e293-4cec-82b1-9f014934d238 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Took 5.47 seconds to snapshot the instance on the hypervisor.
Nov 14 03:32:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] No waiting events found dispatching network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:42 user nova-compute[74836]: WARNING nova.compute.manager [req-774967fc-e5a1-408d-9d8b-af75fd1d5512 req-a9bc8ef1-4544-460d-b871-ade73e9aafcf service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received unexpected event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 for instance with vm_state building and task_state spawning.
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:32:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Instance spawned successfully.
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] No waiting events found dispatching network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:32:44 user nova-compute[74836]: WARNING nova.compute.manager [req-79cc43b9-93d3-4f3e-9e2b-32e21d051bc9 req-1a4ba61c-f780-42c1-9d96-67d006d5cedb service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received unexpected event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 for instance with vm_state building and task_state spawning.
Nov 14 03:32:44 user nova-compute[74836]: INFO nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:32:44 user nova-compute[74836]: INFO nova.compute.manager [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Took 6.55 seconds to build instance.
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6e24cf82-04d9-4d75-ac03-4ececf9ddfb6 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.672s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:44 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing instance network info cache due to event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG nova.network.neutron [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated VIF entry in instance network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG nova.network.neutron [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4272b713-bdc8-4149-ab83-20075571ac8a req-9bdd19d3-8876-42cc-b1b1-3345329f4489 service nova] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.314s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:32:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6454MB free_disk=25.33145523071289GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 685d82a2-1328-48ec-8899-4e8b103c969f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 93de60b4-700f-4284-a8d9-73130522d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f42731c4-27c7-47a6-9381-e8b3834cc027 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cb43e386-c6cb-42bd-9793-c0e7ff22192e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 511e8759-a397-4300-9925-6fdf53a1631d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 28e19196-80cc-4f64-9444-546a29180fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:32:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:32:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:32:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:32:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-changed-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Refreshing instance network info cache due to event network-changed-a53f7b05-8589-4d3f-9fb5-91dd0183e561. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] Acquiring lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] Acquired lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG nova.network.neutron [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Refreshing network info cache for port a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lazy-loading 'flavor' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:04 user nova-compute[74836]: INFO nova.compute.manager [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attaching volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f to /dev/vdb
Nov 14 03:33:04 user nova-compute[74836]: DEBUG os_brick.utils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e504d821-9bf3-465d-94ce-57c666d84a50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c63300-e5b1-4e97-b953-a81bae2028e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf2d5eb-37c0-47ac-9f4c-6f5fcdaeb971]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[019c7f07-e6d8-47d6-abbe-f0037a0ac921]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:05 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764e8c6-2603-4bfe-8009-2e595b1ec872]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG os_brick.utils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating existing volume attachment record: 4d024748-8b44-4e75-89a1-cf711eb55b7c {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG nova.network.neutron [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updated VIF entry in instance network info cache for port a53f7b05-8589-4d3f-9fb5-91dd0183e561. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG nova.network.neutron [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating instance_info_cache with network_info: [{"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05a43565-05fe-4686-8b60-c933503e237e req-87ea35f7-06ea-4381-8044-6a29100e552d service nova] Releasing lock "refresh_cache-f197c8c0-6f1b-4b38-93fc-309e598a4eb6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-changed-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Refreshing instance network info cache due to event network-changed-b81a7dc1-60d9-4d8f-a556-82175a45fa82. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] Acquiring lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] Acquired lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Refreshing network info cache for port b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updated VIF entry in instance network info cache for port b81a7dc1-60d9-4d8f-a556-82175a45fa82. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e25cea9c-1a5b-443c-9370-c15a5c9e57c3 req-39140f8f-5102-4979-bcb8-0be1529d2a82 service nova] Releasing lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-changed-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Refreshing instance network info cache due to event network-changed-79ce1783-30d6-4807-a2bc-5811999bce54. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] Acquiring lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] Acquired lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Refreshing network info cache for port 79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lazy-loading 'flavor' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updated VIF entry in instance network info cache for port 79ce1783-30d6-4807-a2bc-5811999bce54. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating instance_info_cache with network_info: [{"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9bb0e1e2-7bf4-4bd1-89f7-08ddf82a576d req-1e88837d-b55f-44d5-bf60-5ab1c3d6c8d6 service nova] Releasing lock "refresh_cache-56d5cc32-4db6-47c7-9e55-10a01c771c17" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG nova.objects.instance [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'flavor' on Instance uuid a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:07 user nova-compute[74836]: INFO nova.compute.manager [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Attaching volume 806b9a74-6d49-415c-bbc6-04ac380eef07 to /dev/vdb
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG os_brick.utils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfa43e1-cd49-47ec-a703-ff5b52b2db3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f4b844-a1cd-4720-acd7-b6e1c801ac43]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ddd379-0fc5-4068-959d-592ef9738793]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5fec76-176c-4598-9c84-389e3311002f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:08 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48dc077-1d62-4cfa-8d1c-97651c95d69a]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.utils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating existing volume attachment record: 8912445f-4ab7-4a9e-9b6a-d5cdc25e45c1 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:08 user nova-compute[74836]: INFO nova.compute.manager [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Attaching volume 927660d1-aadd-4b5d-a163-20b503c2430d to /dev/vdb
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.utils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45136d4b-6128-458f-be19-844a67cd591f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51decc5-98f5-4aa4-adef-46bbc196dbfb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[62dd28f4-24a9-47e9-83e6-28648ec899ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f554bde-83b2-4cd8-852d-dcd00d826b8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:08 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c541cd4b-682d-4d89-8668-05440616f0ab]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG os_brick.utils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:08 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating existing volume attachment record: 24f7bda3-1984-46eb-8dab-59ab4dcfb69b {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:10 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:10 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:10 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa670c-a138-4d5e-a0e5-0a17d7a496ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:10 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[309eb913-d47c-445c-a84b-2d9851242ed6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f] added
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1730d103-3aed-4003-a8bd-a0ff4162fac6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcb24f-e6f5-4799-8db1-d1b81fac5911]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjbutLCn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjbutLCn" returned: 0 in 0.038s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea9db02-e69c-4845-8b9e-531d9e177abf]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjbutLCn'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbf32de-69e2-4962-ad7a-5dd413f85c10]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f3ae83-0b36-4cdf-b2ef-f23ba1903fa0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:10 user nova-compute[74836]: INFO nova.compute.manager [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Terminating instance
Nov 14 03:33:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57f3723-26bf-49f4-8860-d4ef4821349a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]
Nov 14 03:33:10 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9f636-0eb8-41a6-a881-5ff314f3b8f4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e0d40d-78b1-4b31-a184-118cbd6c1d09]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:10 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dfe544-735a-4cd1-82d6-74bbd4bbf77d]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-unplugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] No waiting events found dispatching network-vif-unplugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf4c487b-79c4-4685-a765-63a1abfa086a req-4019b53a-8d72-4d0f-b721-2c5675920d06 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-unplugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-changed-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing instance network info cache due to event network-changed-c2f23a72-6538-48c5-b99b-e85a17a513fb. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing network info cache for port c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Instance destroyed successfully.
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lazy-loading 'resources' on Instance uuid 685d82a2-1328-48ec-8899-4e8b103c969f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1306554489',display_name='tempest-VolumesActionsTest-instance-1306554489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1306554489',id=6,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08fb1eaebb24491ba633597c0c916bb',ramdisk_id='',reservation_id='r-x4zmijbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1690932671',owner_user_name='tempest-VolumesActionsTest-1690932671-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:29Z,user_data=None,user_id='8b7f7df6faa7429db3e3806475f5e1bc',uuid=685d82a2-1328-48ec-8899-4e8b103c969f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converting VIF {"id": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "address": "fa:16:3e:24:e2:db", "network": {"id": "16e0a6c4-dae6-4365-96eb-3ba588eb5b82", "bridge": "br-int", "label": "tempest-VolumesActionsTest-191496630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08fb1eaebb24491ba633597c0c916bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8ca537d-16", "ovs_interfaceid": "a8ca537d-1602-45a5-a67a-d6ec0f52be7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG os_vif [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8ca537d-16, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae47bd6e-8e1e-449f-8181-2e4b1610c82b) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:11 user nova-compute[74836]: INFO os_vif [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:e2:db,bridge_name='br-int',has_traffic_filtering=True,id=a8ca537d-1602-45a5-a67a-d6ec0f52be7b,network=Network(16e0a6c4-dae6-4365-96eb-3ba588eb5b82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8ca537d-16')
Nov 14 03:33:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Deleting instance files /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f_del
Nov 14 03:33:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Deletion of /opt/stack/data/nova/instances/685d82a2-1328-48ec-8899-4e8b103c969f_del complete
Nov 14 03:33:11 user nova-compute[74836]: INFO nova.compute.manager [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updated VIF entry in instance network info cache for port c2f23a72-6538-48c5-b99b-e85a17a513fb. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f85e793e-6fb2-4665-8940-69681e1306aa req-617216c7-6f64-41af-83d8-f68a05c5b333 service nova] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "interface-93de60b4-700f-4284-a8d9-73130522d402-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "interface-93de60b4-700f-4284-a8d9-73130522d402-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26130666461333663', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130666461333663', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lazy-loading 'flavor' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:33:11 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:11 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:33:11 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:11 user nova-compute[74836]:   <serial>53b42af3-0299-43ac-bfb6-0d2e8d9b776f</serial>
Nov 14 03:33:11 user nova-compute[74836]: </disk>
Nov 14 03:33:11 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'pci_requests' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.objects.base [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Object Instance<93de60b4-700f-4284-a8d9-73130522d402> lazy-loaded attributes: flavor,pci_requests {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:33:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.policy [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9bb4bac46228411d958d4df9fa54b82b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f166a74a4e54512b8d727d6a7648df5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] No VIF found with MAC fa:16:3e:08:96:a9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:12 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Took 1.10 seconds to deallocate network for instance.
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b83458c-b93a-4d89-82f3-e6868ccfaa3b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.687s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLPVKFTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:12 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5af8e-97af-44b6-95c2-e8de36100ede]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:12 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4e847d-d5b1-4cd9-814c-4526a8782420]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07] added
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3348dc-4b28-46ca-9e33-8ba5755904b5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeLvIOpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3901e1-d25f-4128-bbb1-ff4768a22f62]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLPVKFTA {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QLPVKFTA" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed34ff-1ade-4775-b7dd-dc191660ca0c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QLPVKFTA'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Successfully created port: ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4258ff-dc59-4549-9e15-d65e2e4ab19e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[906ba94d-6ccc-4407-af8e-70fdf6c1a0ab]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefa6051-9f07-4567-b242-00e4e04d8e99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260]
Nov 14 03:33:12 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c4124-c195-4630-98d7-df842b687849]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52eafcf-b662-4b82-8449-a852b2d9f8ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:12 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93489421-c71b-4949-9ef4-c471f9658258]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:12 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] Acquiring lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] Lock "685d82a2-1328-48ec-8899-4e8b103c969f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] No waiting events found dispatching network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:13 user nova-compute[74836]: WARNING nova.compute.manager [req-fa0da9c6-e7dd-48b3-bf3b-3f7146995d00 req-9b8dd80a-51cd-4f88-bf37-af57dd66f085 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received unexpected event network-vif-plugged-a8ca537d-1602-45a5-a67a-d6ec0f52be7b for instance with vm_state deleted and task_state None.
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:13 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Deleted allocations for instance 685d82a2-1328-48ec-8899-4e8b103c969f
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-565d21ab-0fd9-4c04-a114-3d574d1fe4d0 tempest-VolumesActionsTest-1690932671 tempest-VolumesActionsTest-1690932671-project-member] Lock "685d82a2-1328-48ec-8899-4e8b103c969f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-845b9639-09a9-4545-ba63-77f448cdc007 req-0d88e024-6def-4034-a71f-fdbfada6e611 service nova] [instance: 685d82a2-1328-48ec-8899-4e8b103c969f] Received event network-vif-deleted-a8ca537d-1602-45a5-a67a-d6ec0f52be7b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Successfully updated port: ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.utils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-changed-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing instance network info cache due to event network-changed-ae83c070-b163-40c6-8e52-7b71714f30c7. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5806602-c1bd-4136-b378-e224ea3252c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e2518-ab37-4ca6-908b-4a630beeeba9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b8ac57-b62a-458a-bf98-666f7ac3af94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba9c35-bea4-46eb-9142-9331efef16c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:13 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[639fabd5-4e2f-496a-b554-aef747f1a5ef]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.utils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:13 user nova-compute[74836]: INFO nova.compute.manager [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Swapping volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f for aea622cb-e062-4bd8-abd3-c58fa24d14f2
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Refreshing network info cache for port ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_vif [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5ebaa11-564c-5a59-90bc-179bd97ae8ab', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae83c070-b1, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae83c070-b1, col_values=(('qos', UUID('4e1aef92-8cf5-44e9-ba3f-baf2b802bb6f')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae83c070-b1, col_values=(('external_ids', {'iface-id': 'ae83c070-b163-40c6-8e52-7b71714f30c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8f:85', 'vm-uuid': '93de60b4-700f-4284-a8d9-73130522d402'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:13 user nova-compute[74836]: INFO os_vif [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1')
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] attach device xml: <interface type="ethernet">
Nov 14 03:33:13 user nova-compute[74836]:   <mac address="fa:16:3e:92:8f:85"/>
Nov 14 03:33:13 user nova-compute[74836]:   <model type="virtio"/>
Nov 14 03:33:13 user nova-compute[74836]:   <mtu size="1442"/>
Nov 14 03:33:13 user nova-compute[74836]:   <target dev="tapae83c070-b1"/>
Nov 14 03:33:13 user nova-compute[74836]: </interface>
Nov 14 03:33:13 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLPVKFTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23264303864376130', 'path': '/dev/sdf'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303864376130', 'path': '/dev/sdf'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.272s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:13 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:13 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lazy-loading 'flavor' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f790cc4-220d-46c8-a0b9-cfa8499b5203]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:14 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd5b088-6452-4fe9-b9ad-acd71cafad63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d] added
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf68ec6-7e13-4496-9a77-5c4db2f964ec]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb8d5d-64dd-41c3-9879-0ac83c9aa90e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 03:33:14 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:14 user nova-compute[74836]:   <source dev="/dev/sdf"/>
Nov 14 03:33:14 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:14 user nova-compute[74836]:   <serial>806b9a74-6d49-415c-bbc6-04ac380eef07</serial>
Nov 14 03:33:14 user nova-compute[74836]: </disk>
Nov 14 03:33:14 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeLvIOpj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yeLvIOpj" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dba5fb0-2b2c-40fb-b8f4-a56630e20dae]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yeLvIOpj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c08bfc5-d9e6-4c63-90a8-8d796faa45d4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640bb39-26f5-48a7-8e65-712c8d779051]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a915e1-aa86-48b2-9b9a-35fa0d2cafa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260]
Nov 14 03:33:14 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb42053-6739-46e2-929e-815dff5507bd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc58443-7b9a-46a3-905c-c120e1f4e8bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:14 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updated VIF entry in instance network info cache for port ae83c070-b163-40c6-8e52-7b71714f30c7. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9e57b2-7069-4867-b1d4-eb2a346843f5]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeLvIOpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-70f3743c-552f-4a77-a225-9c479e244d4c req-6438ea2b-6df6-4ea5-997d-c9f3e44303e7 service nova] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name hda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No VIF found with MAC fa:16:3e:d9:ea:94, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:33:14 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:33:14</nova:creationTime>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:33:14 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:33:14 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:owner>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:33:14 user nova-compute[74836]:   </nova:owner>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:33:14 user nova-compute[74836]:   <nova:ports>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:33:14 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:33:14 user nova-compute[74836]:     </nova:port>
Nov 14 03:33:14 user nova-compute[74836]:     <nova:port uuid="ae83c070-b163-40c6-8e52-7b71714f30c7">
Nov 14 03:33:14 user nova-compute[74836]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 14 03:33:14 user nova-compute[74836]:     </nova:port>
Nov 14 03:33:14 user nova-compute[74836]:   </nova:ports>
Nov 14 03:33:14 user nova-compute[74836]: </nova:instance>
Nov 14 03:33:14 user nova-compute[74836]:  {{(pid=74836) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64cfdfd5-4a6e-4605-859a-678ebda6716e tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "interface-93de60b4-700f-4284-a8d9-73130522d402-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.767s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] No VIF found with MAC fa:16:3e:de:68:7b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4192214c-b6ec-4da0-9273-2f610adaf037 tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.047s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:15 user nova-compute[74836]: INFO nova.compute.manager [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Attaching volume 38909b27-e80d-4d3f-881b-488172937da0 to /dev/vdb
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:15 user nova-compute[74836]: WARNING nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 for instance with vm_state active and task_state None.
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:15 user nova-compute[74836]: WARNING nova.compute.manager [req-f3fc8e94-03c1-42e5-8ad9-3c5923f9e94a req-2f78145b-dc1c-4dbc-8027-383fec09b0b1 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 for instance with vm_state active and task_state None.
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.utils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bbf77c-9d1d-4f56-afbb-e8db5670cf96]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0898dcfd-7b4c-4c7f-89f5-b5bdb0726c32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c710664b-10b6-468e-adbb-63ea0bd7a9ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b1f1b-9089-445e-a7a3-7deb0fff0e43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:15 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d133d258-d371-4287-90aa-afd8ddffa3c2]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.utils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating existing volume attachment record: effaf185-5662-492b-9f9f-43606f81efb2 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] <== connect_volume: return (2700ms) {'type': 'block', 'scsi_wwn': '23230666338376533', 'path': '/dev/sdg'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230666338376533', 'path': '/dev/sdg'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.objects.instance [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'flavor' on Instance uuid a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:33:15 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:15 user nova-compute[74836]:   <source dev="/dev/sdg"/>
Nov 14 03:33:15 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:15 user nova-compute[74836]:   <serial>927660d1-aadd-4b5d-a163-20b503c2430d</serial>
Nov 14 03:33:15 user nova-compute[74836]: </disk>
Nov 14 03:33:15 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No VIF found with MAC fa:16:3e:ec:95:f8, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-97177ee3-5df7-41f9-b35b-bbaa917df1cd tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.959s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] volume_snapshot_create: create_info: {'snapshot_id': '1ab43666-9f40-4c90-8f81-6dbcb7a49a59', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74836) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] snap xml: <domainsnapshot>
Nov 14 03:33:16 user nova-compute[74836]:   <disks>
Nov 14 03:33:16 user nova-compute[74836]:     <disk name="/dev/sdf" snapshot="external" type="file">
Nov 14 03:33:16 user nova-compute[74836]:       <source file="/dev/new_file"/>
Nov 14 03:33:16 user nova-compute[74836]:     </disk>
Nov 14 03:33:16 user nova-compute[74836]:     <disk name="vda" snapshot="no"/>
Nov 14 03:33:16 user nova-compute[74836]:   </disks>
Nov 14 03:33:16 user nova-compute[74836]: </domainsnapshot>
Nov 14 03:33:16 user nova-compute[74836]:  {{(pid=74836) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] Lazy-loading 'system_metadata' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     rv = execute(f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     six.reraise(c, e, tb)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     raise value
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     rv = meth(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     self._volume_snapshot_create(context, instance, guest,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     rv = execute(f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     six.reraise(c, e, tb)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     raise value
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     rv = meth(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] 
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-249bc6f1-5609-481a-8a8e-63179117e5ce tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] volume_snapshot_delete: delete_info: {'volume_id': '806b9a74-6d49-415c-bbc6-04ac380eef07'} {{(pid=74836) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [None req-249bc6f1-5609-481a-8a8e-63179117e5ce tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17]     if delete_info['type'] != 'qcow2':
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] KeyError: 'type'
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 1ab43666-9f40-4c90-8f81-6dbcb7a49a59 could not be found.
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 1ab43666-9f40-4c90-8f81-6dbcb7a49a59 could not be found. (HTTP 404) (Request-ID: req-5d4ce799-b324-4afa-b3c5-e63f4bf3036d)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 1ab43666-9f40-4c90-8f81-6dbcb7a49a59 could not be found.
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server [None req-345ac5d4-590f-4ae9-ae30-e3ace56b21b6 tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver [None req-249bc6f1-5609-481a-8a8e-63179117e5ce tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ab059963-48d6-4a8e-a55b-8536961dc8d4)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 03:33:16 user nova-compute[74836]: ERROR nova.virt.libvirt.driver 
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server [None req-249bc6f1-5609-481a-8a8e-63179117e5ce tempest-VolumesAssistedSnapshotsTest-1560058886 tempest-VolumesAssistedSnapshotsTest-1560058886-project] Exception during message handling: KeyError: 'type'
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 03:33:16 user nova-compute[74836]: ERROR oslo_messaging.rpc.server 
Nov 14 03:33:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:16 user nova-compute[74836]: INFO nova.compute.manager [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Detaching volume 806b9a74-6d49-415c-bbc6-04ac380eef07
Nov 14 03:33:16 user nova-compute[74836]: INFO nova.virt.block_device [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Attempting to driver detach volume 806b9a74-6d49-415c-bbc6-04ac380eef07 from mountpoint /dev/vdb
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Attempting to detach device vdb from instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:16 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:16 user nova-compute[74836]:   <source dev="/dev/sdf"/>
Nov 14 03:33:16 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:16 user nova-compute[74836]:   <serial>806b9a74-6d49-415c-bbc6-04ac380eef07</serial>
Nov 14 03:33:16 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:16 user nova-compute[74836]: </disk>
Nov 14 03:33:16 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Successfully detached device vdb from instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 from the persistent domain config.
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:33:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:16 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:16 user nova-compute[74836]:   <source dev="/dev/sdf"/>
Nov 14 03:33:16 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:16 user nova-compute[74836]:   <serial>806b9a74-6d49-415c-bbc6-04ac380eef07</serial>
Nov 14 03:33:16 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:16 user nova-compute[74836]: </disk>
Nov 14 03:33:16 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:33:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:17 user nova-compute[74836]: INFO nova.compute.manager [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Detaching volume 927660d1-aadd-4b5d-a163-20b503c2430d
Nov 14 03:33:17 user nova-compute[74836]: INFO nova.virt.block_device [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Attempting to driver detach volume 927660d1-aadd-4b5d-a163-20b503c2430d from mountpoint /dev/vdb
Nov 14 03:33:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Attempting to detach device vdb from instance a767ef19-4fe9-4854-aa8f-f769b5d13378 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:33:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:17 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:17 user nova-compute[74836]:   <source dev="/dev/sdg"/>
Nov 14 03:33:17 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:17 user nova-compute[74836]:   <serial>927660d1-aadd-4b5d-a163-20b503c2430d</serial>
Nov 14 03:33:17 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:17 user nova-compute[74836]: </disk>
Nov 14 03:33:17 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully detached device vdb from instance a767ef19-4fe9-4854-aa8f-f769b5d13378 from the persistent domain config.
Nov 14 03:33:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a767ef19-4fe9-4854-aa8f-f769b5d13378 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:33:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:17 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:17 user nova-compute[74836]:   <source dev="/dev/sdg"/>
Nov 14 03:33:17 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:17 user nova-compute[74836]:   <serial>927660d1-aadd-4b5d-a163-20b503c2430d</serial>
Nov 14 03:33:17 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:17 user nova-compute[74836]: </disk>
Nov 14 03:33:17 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'serial': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'serial'} {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:18 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab5ffae-a019-4220-a839-91f252986df3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:18 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f176db77-d133-4fe7-93f1-f87af6bb841f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2] added
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8f386-04e2-4d8b-a7be-620fe4daf6c1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd0db3-094f-44f9-bdfc-414032c75adf]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCAxFgmj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cCAxFgmj" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844feb4-4b82-4d3d-bd49-1427413e9fb9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cCAxFgmj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a99e26-37bf-4c95-8b1d-33ee4bb47d6a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[828c10e6-407e-4c48-8314-09d3340be2ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[930b7a36-9156-4332-90a1-722624f8ed30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260]
Nov 14 03:33:18 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[330b7111-34a3-425a-8c68-462f7a3feb74]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bbece8-e260-402c-845c-e22423395ce9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:18 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac262f6-db04-4806-a2f7-36c99e259876]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23235353235663061', 'path': '/dev/sdh'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235353235663061', 'path': '/dev/sdh'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lazy-loading 'flavor' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzJBnfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:19 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:19 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:19 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d4ad7-fd59-432e-b8da-90b43a5eaf1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:19 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79126a92-5d57-4512-ab28-4b47e24b1795]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0] added
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[922777ad-5623-4f7d-8f6a-79369f7a5abd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11d8cf-c7da-4f27-9348-150019b55c2e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXzJBnfh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VXzJBnfh" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[048761d2-59b9-467c-be2d-d0ad1a2edc56]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VXzJBnfh'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25479fb-a791-4d81-8319-458c66bb5e2e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea42803-5c01-4854-9295-6d965e187a2d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04860af1-e1b0-482a-a157-26a0b0bd53c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260]
Nov 14 03:33:19 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353aaf3-7a7d-4a82-b4b8-06e18737fc23]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fffeb91-4e28-4af6-bda5-4fe6af7b2910]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b964afc-2530-4cb9-aae5-b61e67eb597f]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 181403648 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 377487360 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzJBnfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26166653033313839', 'path': '/dev/sdi'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166653033313839', 'path': '/dev/sdi'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:33:21 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:21 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:33:21 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:21 user nova-compute[74836]:   <serial>38909b27-e80d-4d3f-881b-488172937da0</serial>
Nov 14 03:33:21 user nova-compute[74836]: </disk>
Nov 14 03:33:21 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 516947968 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No BDM found with device name hda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] No VIF found with MAC fa:16:3e:d9:ea:94, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 668991488 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d5fcf15-17e5-4764-9a87-5340b0cd0da9 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.960s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 836763648 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 1005584384 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:23 user nova-compute[74836]: INFO nova.compute.manager [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Detaching volume 38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb74226-fe0a-4469-8343-c9e0209c095f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:23 user nova-compute[74836]: No targets found.
Nov 14 03:33:23 user nova-compute[74836]: iSNS:
Nov 14 03:33:23 user nova-compute[74836]: No targets found.
Nov 14 03:33:23 user nova-compute[74836]: STATIC:
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:23 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:23 user nova-compute[74836]: No targets found.
Nov 14 03:33:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:23 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:23 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a4b3a7-e0f7-49c6-9b7d-80dfcb9205b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: INFO nova.virt.block_device [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Attempting to driver detach volume 38909b27-e80d-4d3f-881b-488172937da0 from mountpoint /dev/vdb
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Attempting to detach device vdb from instance 93de60b4-700f-4284-a8d9-73130522d402 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:23 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:23 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:33:23 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:23 user nova-compute[74836]:   <serial>38909b27-e80d-4d3f-881b-488172937da0</serial>
Nov 14 03:33:23 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 03:33:23 user nova-compute[74836]: </disk>
Nov 14 03:33:23 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully detached device vdb from instance 93de60b4-700f-4284-a8d9-73130522d402 from the persistent domain config.
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93de60b4-700f-4284-a8d9-73130522d402 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:23 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:23 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:33:23 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:23 user nova-compute[74836]:   <serial>38909b27-e80d-4d3f-881b-488172937da0</serial>
Nov 14 03:33:23 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 03:33:23 user nova-compute[74836]: </disk>
Nov 14 03:33:23 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0735aa-dca2-4aac-8160-cbc108369054]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb06ada2-0bc0-4f40-a08c-1e8367f06d59]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4c3230-4805-4793-9ea6-364056ed8e72]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e1a52-d1a5-4161-b7b5-6ea933c2a4a9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e5c97e-e055-4506-902d-6e07f29004a4]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988ebb0-45b4-4f84-91aa-de0b987f158b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9801a6d-df90-4733-a8a0-3cf56c4dd0ee]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]
Nov 14 03:33:23 user nova-compute[74836]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90af8ac-e8c6-4c44-bd38-8a0ffc2cbefc]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== disconnect_volume: return (338ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'serial'} {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 03:33:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: removing Cinder connection for volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 03:33:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:33:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: Updating volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "cCAxFgmj", "auth_password": "GiKn4281c5feXQ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "aea622cb-e062-4bd8-abd3-c58fa24d14f2"}, "status": "reserved", "instance": "f197c8c0-6f1b-4b38-93fc-309e598a4eb6", "attached_at": "", "detached_at": "", "volume_id": "aea622cb-e062-4bd8-abd3-c58fa24d14f2", "serial": "aea622cb-e062-4bd8-abd3-c58fa24d14f2"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'no_device': None, 'attachment_id': '0b1d49e2-bd4d-4fa8-b3a7-81dc1f3dc08e'} {{(pid=74836) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 03:33:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ec5cc778-d491-4b64-b473-283d36267ad7 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.393s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.utils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e7164e-abea-4a1b-954f-593644ed5d17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[54151601-b0b9-466f-ab5c-bd5dc0f32233]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10f3c7-06e0-474f-a812-6b7011541ed0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac7eb02-75f6-4a7d-8def-6ea440a676a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:25 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2093227-75df-4129-a42a-40c637adfa54]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:25 user nova-compute[74836]: DEBUG os_brick.utils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:25 user nova-compute[74836]: INFO nova.compute.manager [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Swapping volume aea622cb-e062-4bd8-abd3-c58fa24d14f2 for 53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'serial': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2'}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'serial'} {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:30 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:30 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:30 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e821d-95a3-4cd3-bd19-67a2a2e96494]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:30 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d5f9d-828f-442f-839c-b14c79539c18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f] added
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b79132a-cc63-4315-af06-e9316184d353]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[766accf0-8395-49f0-8189-01013baf8e4b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjbutLCn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AjbutLCn" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91786fe-aa92-4572-b316-dac3ea0440c5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AjbutLCn'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d648567a-9aad-4782-b553-9b1721a41335]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45a929a-6490-4b63-bebe-c00da59c0687]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cf65b8-8724-4bf6-964a-75eed297cce1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]
Nov 14 03:33:30 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7824c28-72e7-415f-b9c9-f5136623095e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[621475de-eb44-4c25-9f75-a4405c5161bb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] HCTL ('36', '-', '-', 0) found on session 10 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c3b65e-2087-4b51-a823-840cf446b134]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Searching for a device in session 10 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26130666461333663', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26130666461333663', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lazy-loading 'flavor' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 150994944 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 686817280 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 854589440 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-changed-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing instance network info cache due to event network-changed-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] Acquiring lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] Acquired lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Refreshing network info cache for port 0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 1027604480 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cCAxFgmj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'aea622cb-e062-4bd8-abd3-c58fa24d14f2'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:35 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ad800-eb05-4c71-a988-35f9a8a2f13d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:35 user nova-compute[74836]: No targets found.
Nov 14 03:33:35 user nova-compute[74836]: iSNS:
Nov 14 03:33:35 user nova-compute[74836]: No targets found.
Nov 14 03:33:35 user nova-compute[74836]: STATIC:
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:35 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:35 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:35 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:35 user nova-compute[74836]: No targets found.
Nov 14 03:33:35 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:35 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:35 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updated VIF entry in instance network info cache for port 0ed713d4-0000-4c32-a8ad-ea5123b2fbdc. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[622bdc0a-61ec-4592-bfcf-e7fa455a3f01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26105ce5-3913-4a28-b0a9-3ef1e69c575c req-776ae359-4cec-4d06-afe7-3e2419cc6a0b service nova] Releasing lock "refresh_cache-f42731c4-27c7-47a6-9381-e8b3834cc027" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6170e0-1fe7-42bb-a284-796ea2b853eb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:35 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e407a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2'): ({'sdh'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Removing single pathed devices sdh {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[305dea8a-5837-48bc-a2be-9b80010ce961]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833ed25-da01-4a12-9b07-76c42fbd9627]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Flushing IO for device /dev/sdh {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.011s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b487c865-220c-48e6-8813-9e0603c13792]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[72206918-3ade-4ded-90a1-aee1055bf6ad]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] SCSI volumes sdh have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dfde85-dad9-46c2-a1e0-d513c9d0e5a8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6ec6ce-dca9-45dd-9bb9-2f4e09be6708]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260]
Nov 14 03:33:35 user nova-compute[74836]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:35 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aea622cb-e062-4bd8-abd3-c58fa24d14f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12261cd-aee6-4efe-b7f8-b4b5a67b3193]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] <== disconnect_volume: return (319ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f197c8c0-6f1b-4b38-93fc-309e598a4eb6', 'attached_at': '', 'detached_at': '', 'volume_id': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'serial'} {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 03:33:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: removing Cinder connection for volume aea622cb-e062-4bd8-abd3-c58fa24d14f2 {{(pid=74836) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 03:33:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] swap_volume: Updating volume aea622cb-e062-4bd8-abd3-c58fa24d14f2 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "AjbutLCn", "auth_password": "QIT1Ape2FEz9Km", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "53b42af3-0299-43ac-bfb6-0d2e8d9b776f"}, "status": "reserved", "instance": "f197c8c0-6f1b-4b38-93fc-309e598a4eb6", "attached_at": "", "detached_at": "", "volume_id": "53b42af3-0299-43ac-bfb6-0d2e8d9b776f", "serial": "53b42af3-0299-43ac-bfb6-0d2e8d9b776f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'no_device': None, 'attachment_id': 'c61bc8ea-ac6c-4a3c-bfc0-1d50fe9cc995'} {{(pid=74836) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 03:33:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ffd13dfd-1e4c-42ec-8b92-cc5d3f767fc2 tempest-TestVolumeSwap-523257158 tempest-TestVolumeSwap-523257158-project-admin] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.024s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:37 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 is timed out.
Nov 14 03:33:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Successfully detached device vdb from instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 from the live domain config.
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QLPVKFTA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:37 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d93309c-f31e-4a73-a03f-7f36d36605a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:37 user nova-compute[74836]: No targets found.
Nov 14 03:33:37 user nova-compute[74836]: iSNS:
Nov 14 03:33:37 user nova-compute[74836]: No targets found.
Nov 14 03:33:37 user nova-compute[74836]: STATIC:
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:37 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:37 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:37 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:37 user nova-compute[74836]: No targets found.
Nov 14 03:33:37 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:37 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:37 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0e2067-871d-4236-9de4-e23dd8d68f26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24776ca3-0f9e-46ac-a13a-4ebb725cd320]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:37 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:37 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4467d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07'): ({'sdf'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Removing single pathed devices sdf {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d745408-cf75-48ce-9aa2-6e0cef16bb15]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5213f9e-9feb-4d69-8c4d-0c29facf19e0]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Flushing IO for device /dev/sdf {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:37 user nova-compute[74836]: INFO nova.compute.manager [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Terminating instance
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d593c3-f346-4798-8d88-fc724a875a83]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.034s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ababa8-2f00-48c0-9e28-4ce1c7d0aba4]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128630f-8410-4a0f-8bc7-cbd8fd68476a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73b50df-4ae3-41a2-b65c-26aab304fe10]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260]
Nov 14 03:33:37 user nova-compute[74836]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:37 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:806b9a74-6d49-415c-bbc6-04ac380eef07 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[40928cbf-37ed-406a-a29e-0198588ecfcb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] <== disconnect_volume: return (355ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-3be651cc-e99e-4f20-8738-408dca60b64a req-1bb75626-9f44-44cd-a751-78cf67435056 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-3e03edc2-150b-4566-8e6c-6b250d4c22a6 req-0394a409-8659-4109-b507-f61625f8d248 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-0809378c-740e-4637-a58b-e0d6e5c52c4b for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a767ef19-4fe9-4854-aa8f-f769b5d13378 is timed out.
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully detached device vdb from instance a767ef19-4fe9-4854-aa8f-f769b5d13378 from the live domain config.
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yeLvIOpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:38 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: INFO nova.compute.manager [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Detaching volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c62afd-8b85-4132-9f63-33ebd0e76c87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:38 user nova-compute[74836]: No targets found.
Nov 14 03:33:38 user nova-compute[74836]: iSNS:
Nov 14 03:33:38 user nova-compute[74836]: No targets found.
Nov 14 03:33:38 user nova-compute[74836]: STATIC:
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:38 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:38 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:38 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:38 user nova-compute[74836]: No targets found.
Nov 14 03:33:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:38 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:38 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd5760-ba7d-47ee-a2dc-7e7e47cfa0fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbc964-7dc2-4ecc-a5c1-fa3087fd608e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d (non-flash)
Nov 14 03:33:38 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4375c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d'): ({'sdg'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Removing single pathed devices sdg {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:38 user nova-compute[74836]: INFO nova.virt.block_device [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Attempting to driver detach volume 53b42af3-0299-43ac-bfb6-0d2e8d9b776f from mountpoint /dev/vdb
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Attempting to detach device vdb from instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:38 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:38 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:33:38 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:38 user nova-compute[74836]:   <serial>53b42af3-0299-43ac-bfb6-0d2e8d9b776f</serial>
Nov 14 03:33:38 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:38 user nova-compute[74836]: </disk>
Nov 14 03:33:38 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Successfully detached device vdb from instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 from the persistent domain config.
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:33:38 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:38 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:33:38 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:33:38 user nova-compute[74836]:   <serial>53b42af3-0299-43ac-bfb6-0d2e8d9b776f</serial>
Nov 14 03:33:38 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:33:38 user nova-compute[74836]: </disk>
Nov 14 03:33:38 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[97354066-ebe7-4711-8215-a16cc8710950]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b7ecb-3de6-4488-a1e1-7b17a8c19e15]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Flushing IO for device /dev/sdg {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb1d94a-b3d5-4cf7-9d0a-903ce1a5de43]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.055s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c72a79-d091-45f6-a30e-3fcf3a58a5f3]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198226c-ad2a-4942-b40f-fda2977c055c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e37c99-35ab-40d2-ba8a-4c05dee8074c]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260]
Nov 14 03:33:38 user nova-compute[74836]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:927660d1-aadd-4b5d-a163-20b503c2430d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a38ed2-bfbb-44f1-8477-3b858b6f7245]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] <== disconnect_volume: return (386ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-f23f5c35-45d0-4b3b-ae6f-bdc1261f3515 req-9cef27dd-646f-48d9-ac7b-9a1b53bfa482 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG nova.objects.instance [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lazy-loading 'flavor' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-420bda34-d351-4bcb-a80c-6f22444dcd4f tempest-VolumesAssistedSnapshotsTest-1012983949 tempest-VolumesAssistedSnapshotsTest-1012983949-project-admin] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:33:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Instance destroyed successfully.
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lazy-loading 'resources' on Instance uuid f42731c4-27c7-47a6-9381-e8b3834cc027 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ed713d4-00, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'flavor' on Instance uuid a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a765daff-50c9-473a-b6c2-889c49c96a01 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.904s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84ea9ffe-7a28-4232-839b-0fb18c7f722e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=0ed713d4-0000-4c32-a8ad-ea5123b2fbdc,network=Network(319ac6f4-2103-4790-b175-ccc80d5f771d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ed713d4-00')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0809378c-74, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd0589a6-a748-4e2c-a61a-c89a347ae881) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:b6:97,bridge_name='br-int',has_traffic_filtering=True,id=0809378c-740e-4637-a58b-e0d6e5c52c4b,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0809378c-74')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6167949d-68, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31369fbf-c1e3-4e50-bc8c-ed8bbe69fd1a) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:b0:99,bridge_name='br-int',has_traffic_filtering=True,id=6167949d-685a-46f0-a68f-de0f066e79f6,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6167949d-68')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbace32eb-4e, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=963c2ab2-7d64-423b-9be5-e5b4964b7e61) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:8c:f0,bridge_name='br-int',has_traffic_filtering=True,id=bace32eb-4e6b-422c-a453-036c5e1ed0ea,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbace32eb-4e')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38528097-e6, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24147da0-aeb0-4d8c-9166-ed3dc9a3b16f) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:2d:c0,bridge_name='br-int',has_traffic_filtering=True,id=38528097-e6d8-41f9-864b-9eb5651d0f78,network=Network(550bdb7d-001f-4710-a1b5-e75b48820fe9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38528097-e6')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "22928474-efe9-42ba-8a68-196cf02cd7f6", "address": "fa:16:3e:cd:d3:e9", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22928474-ef", "ovs_interfaceid": "22928474-efe9-42ba-8a68-196cf02cd7f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22928474-ef, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=001fdb61-797a-4e12-b5de-3c91d00c91b1) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:39 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:d3:e9,bridge_name='br-int',has_traffic_filtering=True,id=22928474-efe9-42ba-8a68-196cf02cd7f6,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22928474-ef')
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1285768368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1285768368',id=11,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFT9F4X90Qo/ei8VkHc184SjG+ZIpEeIeEjEx/vxL1S89f49EZ/PE5N1e0Nr9FKpgZbjXdUU3VZKJpbqvg4fGU+tCHNLXvLDfmWCoCkFCouJCYZKOAa3UFffCgjjhVGdWw==',key_name='tempest-keypair-169403033',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be3568b751e74d52aca77712447c24f8',ramdisk_id='',reservation_id='r-a5i6auve',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-625165495',owner_user_name='tempest-TaggedBootDevicesTest_v242-625165495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fcef7c3b0e614a88a525e1206a3ac53a',uuid=f42731c4-27c7-47a6-9381-e8b3834cc027,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converting VIF {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:39 user nova-compute[74836]: WARNING nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc for instance with vm_state active and task_state deleting.
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-38528097-e6d8-41f9-864b-9eb5651d0f78 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-38528097-e6d8-41f9-864b-9eb5651d0f78 for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-22928474-efe9-42ba-8a68-196cf02cd7f6 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-8e2fd25e-6ba7-4403-9363-1fe768d505e7 req-20a2f836-6eb6-4178-b83c-932c8980a901 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-22928474-efe9-42ba-8a68-196cf02cd7f6 for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc79ef3d2-9a, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecb214e5-f413-4631-b92b-ba473d653ca1) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: INFO os_vif [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:1f:cc,bridge_name='br-int',has_traffic_filtering=True,id=c79ef3d2-9a8d-45b5-8248-5d191c195299,network=Network(c7d900ee-6358-401c-b784-2cdafdcc22b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc79ef3d2-9a')
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EFWMJjAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f2d8a8-0b74-4bd2-a58a-0fa4130e91ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: iSNS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: STATIC:
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:40 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-0809378c-740e-4637-a58b-e0d6e5c52c4b for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-6167949d-685a-46f0-a68f-de0f066e79f6 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-6167949d-685a-46f0-a68f-de0f066e79f6 for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-unplugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-unplugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-015e8d52-79b4-4a76-816a-b3e5f10e0033 req-a651c468-dd01-45b7-a5b0-b0b9d634099c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-bace32eb-4e6b-422c-a453-036c5e1ed0ea for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb6aac1-42af-46eb-9d3a-8ffe274c7f01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e00b6-82b0-4f96-9a16-3f19b71f0a15]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4473760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b0f1d-f256-4f23-ac6c-f07838870b14]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[713cb773-8745-4760-ba49-19e453a8c1c2]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c9042d-9d5d-4237-8b95-478d111cafc9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a75b13-52a8-4d25-84ef-8833e4e50ff3]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4695703f-47c4-4fc7-b21b-d360009200c9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc69325-97fb-4806-baaf-fa0677b6050d]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260]
Nov 14 03:33:40 user nova-compute[74836]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3b0514c-8d96-4b37-a13e-ad64398d66fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810dad4-4b4d-4144-9c83-8784dc869cf3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== disconnect_volume: return (353ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zMyfxOwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eaf20d-2102-4e61-90bc-789059108454]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: iSNS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: STATIC:
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:40 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207ef49-3a7d-4cd1-8b3a-6ab0bee3843e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd09bb8-2170-4b45-883d-938f394a2e6e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4473760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e91b33-d8e7-412e-afb9-e39b0051b66f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489646c-5e21-4da4-a385-1fa25ee3bceb]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.011s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[096e5afa-f29d-4c3c-a1b1-0ba20883dc2e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8608988-fe82-4e48-b30a-7f411fe0e958]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ca6506-728c-4918-8e6c-91ece97713b6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7297f1-1c69-499e-a14f-8ec440eee4ec]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260]
Nov 14 03:33:40 user nova-compute[74836]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a96dddf-b801-480a-93a8-45422653c042 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd5032-5f49-445c-b716-0ee080c35541]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== disconnect_volume: return (265ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EtaSXZck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc42a8-ac33-4cde-83bc-2691314b4e81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: iSNS:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]: STATIC:
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:40 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:40 user nova-compute[74836]: No targets found.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:40 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:40 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4eb35-53a5-41a1-8edb-4676704ac3fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] Acquiring lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] No waiting events found dispatching network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:40 user nova-compute[74836]: WARNING nova.compute.manager [req-b8dc8d5a-ce57-45ba-b9ef-3a78a8d6e8de req-681fc102-0138-4eb2-bc42-0686466e1535 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received unexpected event network-vif-plugged-c79ef3d2-9a8d-45b5-8248-5d191c195299 for instance with vm_state active and task_state deleting.
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35df01-596a-433e-a235-8294664a49cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4472e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2e052f-08ad-4bd7-a28b-b1a5db5ad998]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f13f58a-4a03-48a7-9865-bb4da32b6bc3]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee6dda-aa24-42d2-b814-0017bc65c83a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[72244e19-4c08-42e3-ad59-ed92ac5f74c3]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f8a9fb-7dc4-4abc-8d02-bd1020b36a47]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48d6676-4fed-4549-8414-ef33947b1f2e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260]
Nov 14 03:33:40 user nova-compute[74836]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:315a61db-9282-467a-9582-eeabeae8ef48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[18532bd7-e34e-40f5-9e87-9257afe61c4f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] <== disconnect_volume: return (287ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Deleting instance files /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027_del
Nov 14 03:33:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Deletion of /opt/stack/data/nova/instances/f42731c4-27c7-47a6-9381-e8b3834cc027_del complete
Nov 14 03:33:41 user nova-compute[74836]: INFO nova.compute.manager [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Took 3.49 seconds to destroy the instance on the hypervisor.
Nov 14 03:33:41 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:33:41 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:33:41 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:33:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-90335dba-bdbf-426a-936e-b03a04147b3b req-ee025cf8-7ca3-4000-8525-7a7c6cd8c6a2 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-deleted-22928474-efe9-42ba-8a68-196cf02cd7f6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:42 user nova-compute[74836]: INFO nova.compute.manager [req-90335dba-bdbf-426a-936e-b03a04147b3b req-ee025cf8-7ca3-4000-8525-7a7c6cd8c6a2 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Neutron deleted interface 22928474-efe9-42ba-8a68-196cf02cd7f6; detaching it from the instance and deleting it from the info cache
Nov 14 03:33:42 user nova-compute[74836]: DEBUG nova.network.neutron [req-90335dba-bdbf-426a-936e-b03a04147b3b req-ee025cf8-7ca3-4000-8525-7a7c6cd8c6a2 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [{"id": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "address": "fa:16:3e:fe:ab:35", "network": {"id": "319ac6f4-2103-4790-b175-ccc80d5f771d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-2123158324-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ed713d4-00", "ovs_interfaceid": "0ed713d4-0000-4c32-a8ad-ea5123b2fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "address": "fa:16:3e:29:b6:97", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0809378c-74", "ovs_interfaceid": "0809378c-740e-4637-a58b-e0d6e5c52c4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6167949d-685a-46f0-a68f-de0f066e79f6", "address": "fa:16:3e:93:b0:99", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6167949d-68", "ovs_interfaceid": "6167949d-685a-46f0-a68f-de0f066e79f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "address": "fa:16:3e:19:8c:f0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.245", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbace32eb-4e", "ovs_interfaceid": "bace32eb-4e6b-422c-a453-036c5e1ed0ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "38528097-e6d8-41f9-864b-9eb5651d0f78", "address": "fa:16:3e:d5:2d:c0", "network": {"id": "550bdb7d-001f-4710-a1b5-e75b48820fe9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1787083141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38528097-e6", "ovs_interfaceid": "38528097-e6d8-41f9-864b-9eb5651d0f78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "address": "fa:16:3e:10:1f:cc", "network": {"id": "c7d900ee-6358-401c-b784-2cdafdcc22b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-900693496", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be3568b751e74d52aca77712447c24f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc79ef3d2-9a", "ovs_interfaceid": "c79ef3d2-9a8d-45b5-8248-5d191c195299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-90335dba-bdbf-426a-936e-b03a04147b3b req-ee025cf8-7ca3-4000-8525-7a7c6cd8c6a2 service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Detach interface failed, port_id=22928474-efe9-42ba-8a68-196cf02cd7f6, reason: Instance f42731c4-27c7-47a6-9381-e8b3834cc027 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:33:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:33:43 user nova-compute[74836]: INFO nova.compute.claims [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Claim successful on node user
Nov 14 03:33:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:33:44 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 93de60b4-700f-4284-a8d9-73130522d402 is timed out.
Nov 14 03:33:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully detached device vdb from instance 93de60b4-700f-4284-a8d9-73130522d402 from the live domain config.
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VXzJBnfh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:44 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8745f6-2fd5-4f2f-9737-42df972a5c9b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:44 user nova-compute[74836]: No targets found.
Nov 14 03:33:44 user nova-compute[74836]: iSNS:
Nov 14 03:33:44 user nova-compute[74836]: No targets found.
Nov 14 03:33:44 user nova-compute[74836]: STATIC:
Nov 14 03:33:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0
Nov 14 03:33:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:44 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:44 user nova-compute[74836]: No targets found.
Nov 14 03:33:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:44 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:44 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765e0e7-fce1-4220-8477-6b806c25f107]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[27be6435-49c0-4aff-b5f5-d735ea107562]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:44 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:44 user nova-compute[74836]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 (non-flash)
Nov 14 03:33:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4210a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0'): ({'sdi'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Removing single pathed devices sdi {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3396968c-769c-4356-b9d1-59f69f8d4471]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb35e30-0191-4b9b-adcf-082270933462]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Flushing IO for device /dev/sdi {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e65e06-29bc-454a-b762-722e84da5225]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db6cfc-5fa2-41d9-af2f-a2063dfa4eb6]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5852ee2-a9d4-4565-8f5e-6210d8d307c0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[062ff573-3f68-41dc-ba26-e03eeac9b70a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260]
Nov 14 03:33:44 user nova-compute[74836]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:44 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Took 3.43 seconds to deallocate network for instance.
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38909b27-e80d-4d3f-881b-488172937da0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0171909d-4095-4b27-ad14-0200fe565e3c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] <== disconnect_volume: return (308ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.policy [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7107bdffb0544dd890311071f04662ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353de76529e464c82aa0d303b797362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:33:44 user nova-compute[74836]: INFO nova.virt.block_device [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Booting with blank volume at /dev/vda
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe51d76d-4c7c-4850-94c7-704f3520a125 req-f6327aa8-b18b-4b61-b40f-b768a994cf0c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-deleted-0ed713d4-0000-4c32-a8ad-ea5123b2fbdc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe51d76d-4c7c-4850-94c7-704f3520a125 req-f6327aa8-b18b-4b61-b40f-b768a994cf0c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-deleted-c79ef3d2-9a8d-45b5-8248-5d191c195299 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe51d76d-4c7c-4850-94c7-704f3520a125 req-f6327aa8-b18b-4b61-b40f-b768a994cf0c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-deleted-bace32eb-4e6b-422c-a453-036c5e1ed0ea {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe51d76d-4c7c-4850-94c7-704f3520a125 req-f6327aa8-b18b-4b61-b40f-b768a994cf0c service nova] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Received event network-vif-deleted-38528097-e6d8-41f9-864b-9eb5651d0f78 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Successfully created port: 778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d024a3b1-c4dc-45be-bdc1-6eef186b1cc0 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Successfully updated port: 778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:45 user nova-compute[74836]: INFO nova.compute.manager [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Terminating instance
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:33:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance network_info: |[{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "interface-93de60b4-700f-4284-a8d9-73130522d402-ae83c070-b163-40c6-8e52-7b71714f30c7" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "interface-93de60b4-700f-4284-a8d9-73130522d402-ae83c070-b163-40c6-8e52-7b71714f30c7" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Attempting to detach device tapae83c070-b1 from instance 93de60b4-700f-4284-a8d9-73130522d402 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] detach device xml: <interface type="ethernet">
Nov 14 03:33:46 user nova-compute[74836]:   <mac address="fa:16:3e:92:8f:85"/>
Nov 14 03:33:46 user nova-compute[74836]:   <model type="virtio"/>
Nov 14 03:33:46 user nova-compute[74836]:   <mtu size="1442"/>
Nov 14 03:33:46 user nova-compute[74836]:   <target dev="tapae83c070-b1"/>
Nov 14 03:33:46 user nova-compute[74836]: </interface>
Nov 14 03:33:46 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 03:33:46 user nova-compute[74836]:   <name>instance-0000000a</name>
Nov 14 03:33:46 user nova-compute[74836]:   <uuid>93de60b4-700f-4284-a8d9-73130522d402</uuid>
Nov 14 03:33:46 user nova-compute[74836]:   <metadata>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:33:46 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:33:14</nova:creationTime>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:33:46 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:33:46 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:owner>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:33:46 user nova-compute[74836]:   </nova:owner>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:33:46 user nova-compute[74836]:   <nova:ports>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:33:46 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:33:46 user nova-compute[74836]:     </nova:port>
Nov 14 03:33:46 user nova-compute[74836]:     <nova:port uuid="ae83c070-b163-40c6-8e52-7b71714f30c7">
Nov 14 03:33:46 user nova-compute[74836]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 14 03:33:46 user nova-compute[74836]:     </nova:port>
Nov 14 03:33:46 user nova-compute[74836]:   </nova:ports>
Nov 14 03:33:46 user nova-compute[74836]: </nova:instance>
Nov 14 03:33:46 user nova-compute[74836]:   </metadata>
Nov 14 03:33:46 user nova-compute[74836]:   <memory unit='KiB'>524288</memory>
Nov 14 03:33:46 user nova-compute[74836]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 03:33:46 user nova-compute[74836]:   <vcpu placement='static'>1</vcpu>
Nov 14 03:33:46 user nova-compute[74836]:   <resource>
Nov 14 03:33:46 user nova-compute[74836]:     <partition>/machine</partition>
Nov 14 03:33:46 user nova-compute[74836]:   </resource>
Nov 14 03:33:46 user nova-compute[74836]:   <sysinfo type='smbios'>
Nov 14 03:33:46 user nova-compute[74836]:     <system>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='version'>0.0.0</entry>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='serial'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='uuid'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:33:46 user nova-compute[74836]:       <entry name='family'>Virtual Machine</entry>
Nov 14 03:33:46 user nova-compute[74836]:     </system>
Nov 14 03:33:46 user nova-compute[74836]:   </sysinfo>
Nov 14 03:33:46 user nova-compute[74836]:   <os>
Nov 14 03:33:46 user nova-compute[74836]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 03:33:46 user nova-compute[74836]:     <boot dev='hd'/>
Nov 14 03:33:46 user nova-compute[74836]:     <smbios mode='sysinfo'/>
Nov 14 03:33:46 user nova-compute[74836]:   </os>
Nov 14 03:33:46 user nova-compute[74836]:   <features>
Nov 14 03:33:46 user nova-compute[74836]:     <acpi/>
Nov 14 03:33:46 user nova-compute[74836]:     <apic/>
Nov 14 03:33:46 user nova-compute[74836]:     <vmcoreinfo state='on'/>
Nov 14 03:33:46 user nova-compute[74836]:   </features>
Nov 14 03:33:46 user nova-compute[74836]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 03:33:46 user nova-compute[74836]:     <model fallback='forbid'>Nehalem</model>
Nov 14 03:33:46 user nova-compute[74836]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 03:33:46 user nova-compute[74836]:     <feature policy='require' name='vme'/>
Nov 14 03:33:46 user nova-compute[74836]:     <feature policy='require' name='x2apic'/>
Nov 14 03:33:46 user nova-compute[74836]:     <feature policy='require' name='hypervisor'/>
Nov 14 03:33:46 user nova-compute[74836]:   </cpu>
Nov 14 03:33:46 user nova-compute[74836]:   <clock offset='utc'>
Nov 14 03:33:46 user nova-compute[74836]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 03:33:46 user nova-compute[74836]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 03:33:46 user nova-compute[74836]:     <timer name='hpet' present='no'/>
Nov 14 03:33:46 user nova-compute[74836]:   </clock>
Nov 14 03:33:46 user nova-compute[74836]:   <on_poweroff>destroy</on_poweroff>
Nov 14 03:33:46 user nova-compute[74836]:   <on_reboot>restart</on_reboot>
Nov 14 03:33:46 user nova-compute[74836]:   <on_crash>destroy</on_crash>
Nov 14 03:33:46 user nova-compute[74836]:   <devices>
Nov 14 03:33:46 user nova-compute[74836]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 03:33:46 user nova-compute[74836]:     <disk type='file' device='disk'>
Nov 14 03:33:46 user nova-compute[74836]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 03:33:46 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk' index='2'/>
Nov 14 03:33:46 user nova-compute[74836]:       <backingStore type='file' index='3'>
Nov 14 03:33:46 user nova-compute[74836]:         <format type='raw'/>
Nov 14 03:33:46 user nova-compute[74836]:         <source file='/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5'/>
Nov 14 03:33:46 user nova-compute[74836]:         <backingStore/>
Nov 14 03:33:46 user nova-compute[74836]:       </backingStore>
Nov 14 03:33:46 user nova-compute[74836]:       <target dev='vda' bus='virtio'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='virtio-disk0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </disk>
Nov 14 03:33:46 user nova-compute[74836]:     <disk type='file' device='cdrom'>
Nov 14 03:33:46 user nova-compute[74836]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 03:33:46 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config' index='1'/>
Nov 14 03:33:46 user nova-compute[74836]:       <backingStore/>
Nov 14 03:33:46 user nova-compute[74836]:       <target dev='hda' bus='ide'/>
Nov 14 03:33:46 user nova-compute[74836]:       <readonly/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='ide0-0-0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </disk>
Nov 14 03:33:46 user nova-compute[74836]:     <controller type='usb' index='0' model='none'>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='usb'/>
Nov 14 03:33:46 user nova-compute[74836]:     </controller>
Nov 14 03:33:46 user nova-compute[74836]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='pci.0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </controller>
Nov 14 03:33:46 user nova-compute[74836]:     <controller type='ide' index='0'>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='ide'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 03:33:46 user nova-compute[74836]:     </controller>
Nov 14 03:33:46 user nova-compute[74836]:     <interface type='ethernet'>
Nov 14 03:33:46 user nova-compute[74836]:       <mac address='fa:16:3e:d9:ea:94'/>
Nov 14 03:33:46 user nova-compute[74836]:       <target dev='tapc2f23a72-65'/>
Nov 14 03:33:46 user nova-compute[74836]:       <model type='virtio'/>
Nov 14 03:33:46 user nova-compute[74836]:       <mtu size='1442'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='net0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </interface>
Nov 14 03:33:46 user nova-compute[74836]:     <interface type='ethernet'>
Nov 14 03:33:46 user nova-compute[74836]:       <mac address='fa:16:3e:92:8f:85'/>
Nov 14 03:33:46 user nova-compute[74836]:       <target dev='tapae83c070-b1'/>
Nov 14 03:33:46 user nova-compute[74836]:       <model type='virtio'/>
Nov 14 03:33:46 user nova-compute[74836]:       <mtu size='1442'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='net1'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </interface>
Nov 14 03:33:46 user nova-compute[74836]:     <serial type='pty'>
Nov 14 03:33:46 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:33:46 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:33:46 user nova-compute[74836]:       <target type='isa-serial' port='0'>
Nov 14 03:33:46 user nova-compute[74836]:         <model name='isa-serial'/>
Nov 14 03:33:46 user nova-compute[74836]:       </target>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </serial>
Nov 14 03:33:46 user nova-compute[74836]:     <console type='pty' tty='/dev/pts/9'>
Nov 14 03:33:46 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:33:46 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:33:46 user nova-compute[74836]:       <target type='serial' port='0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </console>
Nov 14 03:33:46 user nova-compute[74836]:     <input type='mouse' bus='ps2'>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='input0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </input>
Nov 14 03:33:46 user nova-compute[74836]:     <input type='keyboard' bus='ps2'>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='input1'/>
Nov 14 03:33:46 user nova-compute[74836]:     </input>
Nov 14 03:33:46 user nova-compute[74836]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 03:33:46 user nova-compute[74836]:       <listen type='address' address='0.0.0.0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </graphics>
Nov 14 03:33:46 user nova-compute[74836]:     <audio id='1' type='none'/>
Nov 14 03:33:46 user nova-compute[74836]:     <video>
Nov 14 03:33:46 user nova-compute[74836]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='video0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </video>
Nov 14 03:33:46 user nova-compute[74836]:     <memballoon model='virtio'>
Nov 14 03:33:46 user nova-compute[74836]:       <stats period='10'/>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='balloon0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </memballoon>
Nov 14 03:33:46 user nova-compute[74836]:     <rng model='virtio'>
Nov 14 03:33:46 user nova-compute[74836]:       <backend model='random'>/dev/urandom</backend>
Nov 14 03:33:46 user nova-compute[74836]:       <alias name='rng0'/>
Nov 14 03:33:46 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 03:33:46 user nova-compute[74836]:     </rng>
Nov 14 03:33:46 user nova-compute[74836]:   </devices>
Nov 14 03:33:46 user nova-compute[74836]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 03:33:46 user nova-compute[74836]:     <label>libvirt-93de60b4-700f-4284-a8d9-73130522d402</label>
Nov 14 03:33:46 user nova-compute[74836]:     <imagelabel>libvirt-93de60b4-700f-4284-a8d9-73130522d402</imagelabel>
Nov 14 03:33:46 user nova-compute[74836]:   </seclabel>
Nov 14 03:33:46 user nova-compute[74836]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 03:33:46 user nova-compute[74836]:     <label>+64055:+108</label>
Nov 14 03:33:46 user nova-compute[74836]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 03:33:46 user nova-compute[74836]:   </seclabel>
Nov 14 03:33:46 user nova-compute[74836]: </domain>
Nov 14 03:33:46 user nova-compute[74836]:  {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 03:33:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully detached device tapae83c070-b1 from instance 93de60b4-700f-4284-a8d9-73130522d402 from the persistent domain config.
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] (1/8): Attempting to detach device tapae83c070-b1 with device alias net1 from instance 93de60b4-700f-4284-a8d9-73130522d402 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] detach device xml: <interface type="ethernet">
Nov 14 03:33:46 user nova-compute[74836]:   <mac address="fa:16:3e:92:8f:85"/>
Nov 14 03:33:46 user nova-compute[74836]:   <model type="virtio"/>
Nov 14 03:33:46 user nova-compute[74836]:   <mtu size="1442"/>
Nov 14 03:33:46 user nova-compute[74836]:   <target dev="tapae83c070-b1"/>
Nov 14 03:33:46 user nova-compute[74836]: </interface>
Nov 14 03:33:46 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Instance destroyed successfully.
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lazy-loading 'resources' on Instance uuid cb43e386-c6cb-42bd-9793-c0e7ff22192e {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-44429210',display_name='tempest-VolumesNegativeTest-instance-44429210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-44429210',id=12,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59dce7b747694babbb43b8eb56ccfbf0',ramdisk_id='',reservation_id='r-xidi7pxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2020320353',owner_user_name='tempest-VolumesNegativeTest-2020320353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:03Z,user_data=None,user_id='1ec46cf13af0439d87a512dc2d6f7baa',uuid=cb43e386-c6cb-42bd-9793-c0e7ff22192e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converting VIF {"id": "487e84e1-9a9b-4062-9795-c0c62c14749b", "address": "fa:16:3e:2c:b3:13", "network": {"id": "6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9d030b9781be43539094c9dc4294dac7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487e84e1-9a", "ovs_interfaceid": "487e84e1-9a9b-4062-9795-c0c62c14749b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG os_vif [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap487e84e1-9a, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2edb4dec-3356-47fc-a856-39026346bd10) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Start waiting for the detach event from libvirt for device tapae83c070-b1 with device alias net1 for instance 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:46 user nova-compute[74836]: INFO os_vif [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:b3:13,bridge_name='br-int',has_traffic_filtering=True,id=487e84e1-9a9b-4062-9795-c0c62c14749b,network=Network(6a44f92d-aa49-4bcb-bf4b-2bf199d1e7f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487e84e1-9a')
Nov 14 03:33:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Deleting instance files /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e_del
Nov 14 03:33:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Deletion of /opt/stack/data/nova/instances/cb43e386-c6cb-42bd-9793-c0e7ff22192e_del complete
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-changed-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Refreshing instance network info cache due to event network-changed-778fc191-dbfd-4ee5-8a9f-4ca3c4679804. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Refreshing network info cache for port 778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-unplugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-unplugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:46 user nova-compute[74836]: WARNING nova.compute.manager [req-3acaedeb-c881-4769-8469-d6986231a1d7 req-82d66131-d478-41ae-abb4-d9549cd44cc9 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-unplugged-ae83c070-b163-40c6-8e52-7b71714f30c7 for instance with vm_state active and task_state None.
Nov 14 03:33:46 user nova-compute[74836]: INFO nova.compute.manager [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Took 0.81 seconds to destroy the instance on the hypervisor.
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.network.neutron [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updated VIF entry in instance network info cache for port 778fc191-dbfd-4ee5-8a9f-4ca3c4679804. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.network.neutron [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-unplugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] No waiting events found dispatching network-vif-unplugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-unplugged-487e84e1-9a9b-4062-9795-c0c62c14749b for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Acquiring lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] No waiting events found dispatching network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:47 user nova-compute[74836]: WARNING nova.compute.manager [req-4450798a-7d32-4e23-93c0-8820734f6185 req-674f5fdb-6b5d-4f3f-ae25-dd752ea77797 service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received unexpected event network-vif-plugged-487e84e1-9a9b-4062-9795-c0c62c14749b for instance with vm_state active and task_state deleting.
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:47 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Took 0.49 seconds to deallocate network for instance.
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-ddec7c0f-726e-4b19-9b6f-cebe28f1061a req-4a7e5ad9-a03e-47c0-93b7-f4c80d8ab0bd service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Received event network-vif-deleted-487e84e1-9a9b-4062-9795-c0c62c14749b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:47 user nova-compute[74836]: INFO nova.compute.manager [req-ddec7c0f-726e-4b19-9b6f-cebe28f1061a req-4a7e5ad9-a03e-47c0-93b7-f4c80d8ab0bd service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Neutron deleted interface 487e84e1-9a9b-4062-9795-c0c62c14749b; detaching it from the instance and deleting it from the info cache
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.network.neutron [req-ddec7c0f-726e-4b19-9b6f-cebe28f1061a req-4a7e5ad9-a03e-47c0-93b7-f4c80d8ab0bd service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-ddec7c0f-726e-4b19-9b6f-cebe28f1061a req-4a7e5ad9-a03e-47c0-93b7-f4c80d8ab0bd service nova] [instance: cb43e386-c6cb-42bd-9793-c0e7ff22192e] Detach interface failed, port_id=487e84e1-9a9b-4062-9795-c0c62c14749b, reason: Instance cb43e386-c6cb-42bd-9793-c0e7ff22192e could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: INFO nova.compute.manager [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] [instance: f42731c4-27c7-47a6-9381-e8b3834cc027] Took 2.86 seconds to detach 3 volumes for instance.
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.595s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.499s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:47 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Deleted allocations for instance cb43e386-c6cb-42bd-9793-c0e7ff22192e
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-12eec304-357c-4f44-bc28-deccb23446f9 tempest-VolumesNegativeTest-2020320353 tempest-VolumesNegativeTest-2020320353-project-member] Lock "cb43e386-c6cb-42bd-9793-c0e7ff22192e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:48 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Deleted allocations for instance f42731c4-27c7-47a6-9381-e8b3834cc027
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ac866679-749c-443f-a719-157b6a6d7bea tempest-TaggedBootDevicesTest_v242-625165495 tempest-TaggedBootDevicesTest_v242-625165495-project-member] Lock "f42731c4-27c7-47a6-9381-e8b3834cc027" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.948s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] No waiting events found dispatching network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:48 user nova-compute[74836]: WARNING nova.compute.manager [req-64b43b6d-821c-451f-8e67-07820dc3905a req-f044a396-77aa-451e-aee6-89b93efc1eb5 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received unexpected event network-vif-plugged-ae83c070-b163-40c6-8e52-7b71714f30c7 for instance with vm_state active and task_state None.
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:48 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid 'cb43e386-c6cb-42bd-9793-c0e7ff22192e' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'cb43e386-c6cb-42bd-9793-c0e7ff22192e' (instance-0000000c)
Nov 14 03:33:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd85c464-3b1c-415c-a199-60ef30801038]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[430daa3e-5bc9-457b-a896-61b111396ff0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04c1dd2-df75-4323-aab3-527415f906bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aeff76-dd64-4bde-b208-a12673632bc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:50 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50fe6e3-ab2e-4611-be8e-116f955af082]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating existing volume attachment record: 8eb41d7a-0b69-4d9e-aaff-5af33ce025b9 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:33:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6971MB free_disk=25.302898406982422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 93de60b4-700f-4284-a8d9-73130522d402 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 511e8759-a397-4300-9925-6fdf53a1631d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 28e19196-80cc-4f64-9444-546a29180fb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:33:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:33:52 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:33:52 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:33:52 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:33:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:33:54 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Creating image(s)
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Ensure instance console log exists: /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start _get_guest_xml network_info=[{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'serial': 'f3bdddb8-7fcc-48b4-9cab-0e0c66a34749'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8eb41d7a-0b69-4d9e-aaff-5af33ce025b9', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:33:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:33:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:54 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c59ab4-1bad-4af1-a2bc-8bd1e420a947]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:33:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d86dc8-c458-4d50-9e8c-f2a9ae1fb4d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749] added
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ada18bf-58e8-474b-8196-577d4ce6c351]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7055e5-8f28-4bf6-b979-df22ad1df3a7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOJKfspj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOJKfspj" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04fdf06-cf29-421c-b8ea-295558730f0b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xOJKfspj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[116507ac-1b05-4ca8-a661-f42c7ce73460]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bbd1b8-92f0-44b4-963e-eda75336616e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e6a0dd-12bd-45e0-8b1e-337451287246]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260]
Nov 14 03:33:54 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccae683-6168-4395-ace4-21e5659c41cd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6697bb2-6e2a-4898-b4b1-00bb2296a437]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:54 user nova-compute[74836]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:54 user nova-compute[74836]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:33:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e1c97a-f4c9-4c41-a7ec-526f68d66517]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26564663435376636', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564663435376636', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1784073350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1784073350',id=15,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-vlp9ukwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:33:45Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:33:55 user nova-compute[74836]:   <uuid>cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</uuid>
Nov 14 03:33:55 user nova-compute[74836]:   <name>instance-0000000f</name>
Nov 14 03:33:55 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:33:55 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:33:55 user nova-compute[74836]:   <metadata>
Nov 14 03:33:55 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:33:55 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1784073350</nova:name>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:33:54</nova:creationTime>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:33:55 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:33:55 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:owner>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:33:55 user nova-compute[74836]:       </nova:owner>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:33:55 user nova-compute[74836]:       <nova:ports>
Nov 14 03:33:55 user nova-compute[74836]:         <nova:port uuid="778fc191-dbfd-4ee5-8a9f-4ca3c4679804">
Nov 14 03:33:55 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:33:55 user nova-compute[74836]:         </nova:port>
Nov 14 03:33:55 user nova-compute[74836]:       </nova:ports>
Nov 14 03:33:55 user nova-compute[74836]:     </nova:instance>
Nov 14 03:33:55 user nova-compute[74836]:   </metadata>
Nov 14 03:33:55 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:33:55 user nova-compute[74836]:     <system>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="serial">cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</entry>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="uuid">cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</entry>
Nov 14 03:33:55 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:33:55 user nova-compute[74836]:     </system>
Nov 14 03:33:55 user nova-compute[74836]:   </sysinfo>
Nov 14 03:33:55 user nova-compute[74836]:   <os>
Nov 14 03:33:55 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:33:55 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:33:55 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:33:55 user nova-compute[74836]:   </os>
Nov 14 03:33:55 user nova-compute[74836]:   <features>
Nov 14 03:33:55 user nova-compute[74836]:     <acpi/>
Nov 14 03:33:55 user nova-compute[74836]:     <apic/>
Nov 14 03:33:55 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:33:55 user nova-compute[74836]:   </features>
Nov 14 03:33:55 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:33:55 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:33:55 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:33:55 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:33:55 user nova-compute[74836]:   </clock>
Nov 14 03:33:55 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:33:55 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:33:55 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:33:55 user nova-compute[74836]:   </cpu>
Nov 14 03:33:55 user nova-compute[74836]:   <devices>
Nov 14 03:33:55 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:33:55 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:33:55 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 03:33:55 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:33:55 user nova-compute[74836]:       <serial>f3bdddb8-7fcc-48b4-9cab-0e0c66a34749</serial>
Nov 14 03:33:55 user nova-compute[74836]:     </disk>
Nov 14 03:33:55 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:33:55 user nova-compute[74836]:       <mac address="fa:16:3e:54:0b:4f"/>
Nov 14 03:33:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:33:55 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:33:55 user nova-compute[74836]:       <target dev="tap778fc191-db"/>
Nov 14 03:33:55 user nova-compute[74836]:     </interface>
Nov 14 03:33:55 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:33:55 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/console.log" append="off"/>
Nov 14 03:33:55 user nova-compute[74836]:     </serial>
Nov 14 03:33:55 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:33:55 user nova-compute[74836]:     <video>
Nov 14 03:33:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:33:55 user nova-compute[74836]:     </video>
Nov 14 03:33:55 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:33:55 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:33:55 user nova-compute[74836]:     </rng>
Nov 14 03:33:55 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:33:55 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:33:55 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:33:55 user nova-compute[74836]:     </memballoon>
Nov 14 03:33:55 user nova-compute[74836]:   </devices>
Nov 14 03:33:55 user nova-compute[74836]: </domain>
Nov 14 03:33:55 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1784073350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1784073350',id=15,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-vlp9ukwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:33:45Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG os_vif [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6996b84b-9789-564b-9aa0-f9720f99eb5c', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap778fc191-db, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap778fc191-db, col_values=(('qos', UUID('7452daf9-ba8c-4b0c-ba4a-afe320feb133')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap778fc191-db, col_values=(('external_ids', {'iface-id': '778fc191-dbfd-4ee5-8a9f-4ca3c4679804', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:0b:4f', 'vm-uuid': 'cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:55 user nova-compute[74836]: INFO os_vif [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db')
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:33:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:54:0b:4f, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:57 user nova-compute[74836]: WARNING nova.compute.manager [req-84e68d18-38a2-43ec-9aab-2f356d76eb45 req-c45944cc-a92c-46be-a2c5-be5609bb8e37 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state building and task_state spawning.
Nov 14 03:33:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:33:59 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 is timed out.
Nov 14 03:33:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Successfully detached device vdb from instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 from the live domain config.
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AjbutLCn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '53b42af3-0299-43ac-bfb6-0d2e8d9b776f'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:59 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da1f14-b5e3-411f-ae9f-8696d0e4a3b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:33:59 user nova-compute[74836]: No targets found.
Nov 14 03:33:59 user nova-compute[74836]: iSNS:
Nov 14 03:33:59 user nova-compute[74836]: No targets found.
Nov 14 03:33:59 user nova-compute[74836]: STATIC:
Nov 14 03:33:59 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f
Nov 14 03:33:59 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:59 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:59 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:33:59 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:33:59 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:33:59 user nova-compute[74836]: FIRMWARE:
Nov 14 03:33:59 user nova-compute[74836]: No targets found.
Nov 14 03:33:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:33:59 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:33:59 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d518bd0-7808-485e-b803-992b1e7531b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055bee0-1753-4f89-aa72-e2c99bdb4116]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:59 user nova-compute[74836]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:33:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f (non-flash)
Nov 14 03:33:59 user nova-compute[74836]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:33:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4303760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b370c8-55c9-4217-a1c9-4dc5904b778a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b9265b-5c7e-49a8-a20d-210ae3f662a0]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b539970-cf0f-42a9-81f8-f9e8d69eda39]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a692f743-9d53-4d90-9988-cfecb470a7da]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85323f5d-0298-4742-82f5-e0ab9836e93a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:33:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance spawned successfully.
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c706e4-7def-4f3d-b64f-5056717df3f8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260]
Nov 14 03:33:59 user nova-compute[74836]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f, portal: 172.16.0.220,3260] successful.
Nov 14 03:33:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.objects.instance [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53b42af3-0299-43ac-bfb6-0d2e8d9b776f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7082f-3674-43a2-9721-626af7db5947]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] <== disconnect_volume: return (284ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:59 user nova-compute[74836]: INFO nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:33:59 user nova-compute[74836]: WARNING nova.compute.manager [req-c57ec359-2f50-4d29-b427-f8944189e10a req-3168da1a-9a38-497d-9a4f-5abdb68f9dfd service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state building and task_state spawning.
Nov 14 03:33:59 user nova-compute[74836]: INFO nova.compute.manager [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Took 15.77 seconds to build instance.
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b1cba48-63bb-4ec6-9e4c-33543ab041a9 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.871s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:33:59 user nova-compute[74836]: INFO nova.compute.manager [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Attaching volume fb1a41e7-8a76-42f0-b7c8-d7181fd3521c to /dev/vdb
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c667463-72ed-4544-b950-22879832d454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae25724-63f1-48d1-9e04-5e397f67d855]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[253b9b3f-84ee-446a-b6e2-9ba04283db5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d52b43-4179-4e94-9e94-8309dbcf5a39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:33:59 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:33:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc7db2f-eee2-4b84-8c0a-ae2ce50ad5d1]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:33:59 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating existing volume attachment record: 497d231c-b208-470e-9a93-97bba2392f9e {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:34:00 user nova-compute[74836]: DEBUG nova.objects.instance [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lazy-loading 'flavor' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-29f95651-cba5-48d1-bc74-0b8329eca55b tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:34:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:34:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:34:03 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28e9e10-c13e-48fd-928d-9b243726cc47]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:34:03 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5f743d-240c-4d6b-b398-f6736593c9c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c] added
Nov 14 03:34:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5eb95-1899-4a11-9fc4-40804f173e82]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2993432-4386-4f8b-8dc7-8a0316d38d10]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuIqbcjJ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuIqbcjJ" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93e260c-440b-439c-92ab-799b5ad25649]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MuIqbcjJ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca4c04-6e91-4ca3-a664-e87c521b1588]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0b840b-3638-45c6-85f9-d4bb97915e53]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831eec2-bc45-4d53-bc16-2d1cffc24aef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]
Nov 14 03:34:04 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.
Nov 14 03:34:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e9f73-715b-42e1-81b1-47478754f661]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5673e97e-21e6-43a9-ae6b-3045564bc88f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:04 user nova-compute[74836]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:04 user nova-compute[74836]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6658864e-460a-46d0-bf74-7d95508fb05a]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26662623436323865', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623436323865', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:34:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:34:05 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:34:05 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:34:05 user nova-compute[74836]:   <serial>fb1a41e7-8a76-42f0-b7c8-d7181fd3521c</serial>
Nov 14 03:34:05 user nova-compute[74836]: </disk>
Nov 14 03:34:05 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No VIF found with MAC fa:16:3e:2f:96:1b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-188198a4-1a92-4181-945a-fbbaa7975e15 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.157s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Waiting for libvirt event about the detach of device tapae83c070-b1 with device alias net1 from instance 93de60b4-700f-4284-a8d9-73130522d402 is timed out.
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 03:34:06 user nova-compute[74836]:   <name>instance-0000000a</name>
Nov 14 03:34:06 user nova-compute[74836]:   <uuid>93de60b4-700f-4284-a8d9-73130522d402</uuid>
Nov 14 03:34:06 user nova-compute[74836]:   <metadata>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:06 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:33:14</nova:creationTime>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:34:06 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:owner>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:owner>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:ports>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:34:06 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:34:06 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:port uuid="ae83c070-b163-40c6-8e52-7b71714f30c7">
Nov 14 03:34:06 user nova-compute[74836]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Nov 14 03:34:06 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:ports>
Nov 14 03:34:06 user nova-compute[74836]: </nova:instance>
Nov 14 03:34:06 user nova-compute[74836]:   </metadata>
Nov 14 03:34:06 user nova-compute[74836]:   <memory unit='KiB'>524288</memory>
Nov 14 03:34:06 user nova-compute[74836]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 03:34:06 user nova-compute[74836]:   <vcpu placement='static'>1</vcpu>
Nov 14 03:34:06 user nova-compute[74836]:   <resource>
Nov 14 03:34:06 user nova-compute[74836]:     <partition>/machine</partition>
Nov 14 03:34:06 user nova-compute[74836]:   </resource>
Nov 14 03:34:06 user nova-compute[74836]:   <sysinfo type='smbios'>
Nov 14 03:34:06 user nova-compute[74836]:     <system>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='version'>0.0.0</entry>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='serial'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='uuid'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:06 user nova-compute[74836]:       <entry name='family'>Virtual Machine</entry>
Nov 14 03:34:06 user nova-compute[74836]:     </system>
Nov 14 03:34:06 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:06 user nova-compute[74836]:   <os>
Nov 14 03:34:06 user nova-compute[74836]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 03:34:06 user nova-compute[74836]:     <boot dev='hd'/>
Nov 14 03:34:06 user nova-compute[74836]:     <smbios mode='sysinfo'/>
Nov 14 03:34:06 user nova-compute[74836]:   </os>
Nov 14 03:34:06 user nova-compute[74836]:   <features>
Nov 14 03:34:06 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:06 user nova-compute[74836]:     <apic/>
Nov 14 03:34:06 user nova-compute[74836]:     <vmcoreinfo state='on'/>
Nov 14 03:34:06 user nova-compute[74836]:   </features>
Nov 14 03:34:06 user nova-compute[74836]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 03:34:06 user nova-compute[74836]:     <model fallback='forbid'>Nehalem</model>
Nov 14 03:34:06 user nova-compute[74836]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 03:34:06 user nova-compute[74836]:     <feature policy='require' name='vme'/>
Nov 14 03:34:06 user nova-compute[74836]:     <feature policy='require' name='x2apic'/>
Nov 14 03:34:06 user nova-compute[74836]:     <feature policy='require' name='hypervisor'/>
Nov 14 03:34:06 user nova-compute[74836]:   </cpu>
Nov 14 03:34:06 user nova-compute[74836]:   <clock offset='utc'>
Nov 14 03:34:06 user nova-compute[74836]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 03:34:06 user nova-compute[74836]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 03:34:06 user nova-compute[74836]:     <timer name='hpet' present='no'/>
Nov 14 03:34:06 user nova-compute[74836]:   </clock>
Nov 14 03:34:06 user nova-compute[74836]:   <on_poweroff>destroy</on_poweroff>
Nov 14 03:34:06 user nova-compute[74836]:   <on_reboot>restart</on_reboot>
Nov 14 03:34:06 user nova-compute[74836]:   <on_crash>destroy</on_crash>
Nov 14 03:34:06 user nova-compute[74836]:   <devices>
Nov 14 03:34:06 user nova-compute[74836]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 03:34:06 user nova-compute[74836]:     <disk type='file' device='disk'>
Nov 14 03:34:06 user nova-compute[74836]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 03:34:06 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk' index='2'/>
Nov 14 03:34:06 user nova-compute[74836]:       <backingStore type='file' index='3'>
Nov 14 03:34:06 user nova-compute[74836]:         <format type='raw'/>
Nov 14 03:34:06 user nova-compute[74836]:         <source file='/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5'/>
Nov 14 03:34:06 user nova-compute[74836]:         <backingStore/>
Nov 14 03:34:06 user nova-compute[74836]:       </backingStore>
Nov 14 03:34:06 user nova-compute[74836]:       <target dev='vda' bus='virtio'/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='virtio-disk0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </disk>
Nov 14 03:34:06 user nova-compute[74836]:     <disk type='file' device='cdrom'>
Nov 14 03:34:06 user nova-compute[74836]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 03:34:06 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config' index='1'/>
Nov 14 03:34:06 user nova-compute[74836]:       <backingStore/>
Nov 14 03:34:06 user nova-compute[74836]:       <target dev='hda' bus='ide'/>
Nov 14 03:34:06 user nova-compute[74836]:       <readonly/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='ide0-0-0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </disk>
Nov 14 03:34:06 user nova-compute[74836]:     <controller type='usb' index='0' model='none'>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='usb'/>
Nov 14 03:34:06 user nova-compute[74836]:     </controller>
Nov 14 03:34:06 user nova-compute[74836]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='pci.0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </controller>
Nov 14 03:34:06 user nova-compute[74836]:     <controller type='ide' index='0'>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='ide'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 03:34:06 user nova-compute[74836]:     </controller>
Nov 14 03:34:06 user nova-compute[74836]:     <interface type='ethernet'>
Nov 14 03:34:06 user nova-compute[74836]:       <mac address='fa:16:3e:d9:ea:94'/>
Nov 14 03:34:06 user nova-compute[74836]:       <target dev='tapc2f23a72-65'/>
Nov 14 03:34:06 user nova-compute[74836]:       <model type='virtio'/>
Nov 14 03:34:06 user nova-compute[74836]:       <mtu size='1442'/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='net0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </interface>
Nov 14 03:34:06 user nova-compute[74836]:     <serial type='pty'>
Nov 14 03:34:06 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:06 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:06 user nova-compute[74836]:       <target type='isa-serial' port='0'>
Nov 14 03:34:06 user nova-compute[74836]:         <model name='isa-serial'/>
Nov 14 03:34:06 user nova-compute[74836]:       </target>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </serial>
Nov 14 03:34:06 user nova-compute[74836]:     <console type='pty' tty='/dev/pts/9'>
Nov 14 03:34:06 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:06 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:06 user nova-compute[74836]:       <target type='serial' port='0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </console>
Nov 14 03:34:06 user nova-compute[74836]:     <input type='mouse' bus='ps2'>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='input0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </input>
Nov 14 03:34:06 user nova-compute[74836]:     <input type='keyboard' bus='ps2'>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='input1'/>
Nov 14 03:34:06 user nova-compute[74836]:     </input>
Nov 14 03:34:06 user nova-compute[74836]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 03:34:06 user nova-compute[74836]:       <listen type='address' address='0.0.0.0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </graphics>
Nov 14 03:34:06 user nova-compute[74836]:     <audio id='1' type='none'/>
Nov 14 03:34:06 user nova-compute[74836]:     <video>
Nov 14 03:34:06 user nova-compute[74836]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='video0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </video>
Nov 14 03:34:06 user nova-compute[74836]:     <memballoon model='virtio'>
Nov 14 03:34:06 user nova-compute[74836]:       <stats period='10'/>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='balloon0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:06 user nova-compute[74836]:     <rng model='virtio'>
Nov 14 03:34:06 user nova-compute[74836]:       <backend model='random'>/dev/urandom</backend>
Nov 14 03:34:06 user nova-compute[74836]:       <alias name='rng0'/>
Nov 14 03:34:06 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 03:34:06 user nova-compute[74836]:     </rng>
Nov 14 03:34:06 user nova-compute[74836]:   </devices>
Nov 14 03:34:06 user nova-compute[74836]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 03:34:06 user nova-compute[74836]:     <label>libvirt-93de60b4-700f-4284-a8d9-73130522d402</label>
Nov 14 03:34:06 user nova-compute[74836]:     <imagelabel>libvirt-93de60b4-700f-4284-a8d9-73130522d402</imagelabel>
Nov 14 03:34:06 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:06 user nova-compute[74836]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 03:34:06 user nova-compute[74836]:     <label>+64055:+108</label>
Nov 14 03:34:06 user nova-compute[74836]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 03:34:06 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:06 user nova-compute[74836]: </domain>
Nov 14 03:34:06 user nova-compute[74836]:  {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 03:34:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully detached device tapae83c070-b1 from instance 93de60b4-700f-4284-a8d9-73130522d402 from the live domain config.
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG os_vif [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae83c070-b1, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e1aef92-8cf5-44e9-ba3f-baf2b802bb6f) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:06 user nova-compute[74836]: INFO os_vif [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1')
Nov 14 03:34:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:06 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:34:06</nova:creationTime>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:34:06 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:owner>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:owner>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:06 user nova-compute[74836]:   <nova:ports>
Nov 14 03:34:06 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:34:06 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:34:06 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:06 user nova-compute[74836]:   </nova:ports>
Nov 14 03:34:06 user nova-compute[74836]: </nova:instance>
Nov 14 03:34:06 user nova-compute[74836]:  {{(pid=74836) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-deleted-ae83c070-b163-40c6-8e52-7b71714f30c7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:07 user nova-compute[74836]: INFO nova.compute.manager [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Neutron deleted interface ae83c070-b163-40c6-8e52-7b71714f30c7; detaching it from the instance and deleting it from the info cache
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquired lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.objects.instance [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Lazy-loading 'system_metadata' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.objects.instance [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Lazy-loading 'flavor' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.objects.base [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Object Instance<93de60b4-700f-4284-a8d9-73130522d402> lazy-loaded attributes: system_metadata,flavor {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 03:34:07 user nova-compute[74836]:   <name>instance-0000000a</name>
Nov 14 03:34:07 user nova-compute[74836]:   <uuid>93de60b4-700f-4284-a8d9-73130522d402</uuid>
Nov 14 03:34:07 user nova-compute[74836]:   <metadata>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:07 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:34:06</nova:creationTime>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:34:07 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:ports>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:34:07 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:34:07 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:ports>
Nov 14 03:34:07 user nova-compute[74836]: </nova:instance>
Nov 14 03:34:07 user nova-compute[74836]:   </metadata>
Nov 14 03:34:07 user nova-compute[74836]:   <memory unit='KiB'>524288</memory>
Nov 14 03:34:07 user nova-compute[74836]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 03:34:07 user nova-compute[74836]:   <vcpu placement='static'>1</vcpu>
Nov 14 03:34:07 user nova-compute[74836]:   <resource>
Nov 14 03:34:07 user nova-compute[74836]:     <partition>/machine</partition>
Nov 14 03:34:07 user nova-compute[74836]:   </resource>
Nov 14 03:34:07 user nova-compute[74836]:   <sysinfo type='smbios'>
Nov 14 03:34:07 user nova-compute[74836]:     <system>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='version'>0.0.0</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='serial'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='uuid'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='family'>Virtual Machine</entry>
Nov 14 03:34:07 user nova-compute[74836]:     </system>
Nov 14 03:34:07 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:07 user nova-compute[74836]:   <os>
Nov 14 03:34:07 user nova-compute[74836]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 03:34:07 user nova-compute[74836]:     <boot dev='hd'/>
Nov 14 03:34:07 user nova-compute[74836]:     <smbios mode='sysinfo'/>
Nov 14 03:34:07 user nova-compute[74836]:   </os>
Nov 14 03:34:07 user nova-compute[74836]:   <features>
Nov 14 03:34:07 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:07 user nova-compute[74836]:     <apic/>
Nov 14 03:34:07 user nova-compute[74836]:     <vmcoreinfo state='on'/>
Nov 14 03:34:07 user nova-compute[74836]:   </features>
Nov 14 03:34:07 user nova-compute[74836]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 03:34:07 user nova-compute[74836]:     <model fallback='forbid'>Nehalem</model>
Nov 14 03:34:07 user nova-compute[74836]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='vme'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='x2apic'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='hypervisor'/>
Nov 14 03:34:07 user nova-compute[74836]:   </cpu>
Nov 14 03:34:07 user nova-compute[74836]:   <clock offset='utc'>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='hpet' present='no'/>
Nov 14 03:34:07 user nova-compute[74836]:   </clock>
Nov 14 03:34:07 user nova-compute[74836]:   <on_poweroff>destroy</on_poweroff>
Nov 14 03:34:07 user nova-compute[74836]:   <on_reboot>restart</on_reboot>
Nov 14 03:34:07 user nova-compute[74836]:   <on_crash>destroy</on_crash>
Nov 14 03:34:07 user nova-compute[74836]:   <devices>
Nov 14 03:34:07 user nova-compute[74836]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 03:34:07 user nova-compute[74836]:     <disk type='file' device='disk'>
Nov 14 03:34:07 user nova-compute[74836]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 03:34:07 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk' index='2'/>
Nov 14 03:34:07 user nova-compute[74836]:       <backingStore type='file' index='3'>
Nov 14 03:34:07 user nova-compute[74836]:         <format type='raw'/>
Nov 14 03:34:07 user nova-compute[74836]:         <source file='/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5'/>
Nov 14 03:34:07 user nova-compute[74836]:         <backingStore/>
Nov 14 03:34:07 user nova-compute[74836]:       </backingStore>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='vda' bus='virtio'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='virtio-disk0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </disk>
Nov 14 03:34:07 user nova-compute[74836]:     <disk type='file' device='cdrom'>
Nov 14 03:34:07 user nova-compute[74836]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 03:34:07 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config' index='1'/>
Nov 14 03:34:07 user nova-compute[74836]:       <backingStore/>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='hda' bus='ide'/>
Nov 14 03:34:07 user nova-compute[74836]:       <readonly/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='ide0-0-0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </disk>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='usb' index='0' model='none'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='usb'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='pci.0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='ide' index='0'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='ide'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <interface type='ethernet'>
Nov 14 03:34:07 user nova-compute[74836]:       <mac address='fa:16:3e:d9:ea:94'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='tapc2f23a72-65'/>
Nov 14 03:34:07 user nova-compute[74836]:       <model type='virtio'/>
Nov 14 03:34:07 user nova-compute[74836]:       <mtu size='1442'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='net0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </interface>
Nov 14 03:34:07 user nova-compute[74836]:     <serial type='pty'>
Nov 14 03:34:07 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:07 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target type='isa-serial' port='0'>
Nov 14 03:34:07 user nova-compute[74836]:         <model name='isa-serial'/>
Nov 14 03:34:07 user nova-compute[74836]:       </target>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </serial>
Nov 14 03:34:07 user nova-compute[74836]:     <console type='pty' tty='/dev/pts/9'>
Nov 14 03:34:07 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:07 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target type='serial' port='0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </console>
Nov 14 03:34:07 user nova-compute[74836]:     <input type='mouse' bus='ps2'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='input0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </input>
Nov 14 03:34:07 user nova-compute[74836]:     <input type='keyboard' bus='ps2'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='input1'/>
Nov 14 03:34:07 user nova-compute[74836]:     </input>
Nov 14 03:34:07 user nova-compute[74836]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 03:34:07 user nova-compute[74836]:       <listen type='address' address='0.0.0.0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </graphics>
Nov 14 03:34:07 user nova-compute[74836]:     <audio id='1' type='none'/>
Nov 14 03:34:07 user nova-compute[74836]:     <video>
Nov 14 03:34:07 user nova-compute[74836]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='video0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </video>
Nov 14 03:34:07 user nova-compute[74836]:     <memballoon model='virtio'>
Nov 14 03:34:07 user nova-compute[74836]:       <stats period='10'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='balloon0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:07 user nova-compute[74836]:     <rng model='virtio'>
Nov 14 03:34:07 user nova-compute[74836]:       <backend model='random'>/dev/urandom</backend>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='rng0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </rng>
Nov 14 03:34:07 user nova-compute[74836]:   </devices>
Nov 14 03:34:07 user nova-compute[74836]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 03:34:07 user nova-compute[74836]:     <label>libvirt-93de60b4-700f-4284-a8d9-73130522d402</label>
Nov 14 03:34:07 user nova-compute[74836]:     <imagelabel>libvirt-93de60b4-700f-4284-a8d9-73130522d402</imagelabel>
Nov 14 03:34:07 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:07 user nova-compute[74836]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 03:34:07 user nova-compute[74836]:     <label>+64055:+108</label>
Nov 14 03:34:07 user nova-compute[74836]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 03:34:07 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:07 user nova-compute[74836]: </domain>
Nov 14 03:34:07 user nova-compute[74836]:  {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface> {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:92:8f:85"/><model type="virtio"/><mtu size="1442"/><target dev="tapae83c070-b1"/></interface>not found in domain: <domain type='kvm' id='10'>
Nov 14 03:34:07 user nova-compute[74836]:   <name>instance-0000000a</name>
Nov 14 03:34:07 user nova-compute[74836]:   <uuid>93de60b4-700f-4284-a8d9-73130522d402</uuid>
Nov 14 03:34:07 user nova-compute[74836]:   <metadata>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:07 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:34:06</nova:creationTime>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:34:07 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:ports>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:34:07 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:34:07 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:ports>
Nov 14 03:34:07 user nova-compute[74836]: </nova:instance>
Nov 14 03:34:07 user nova-compute[74836]:   </metadata>
Nov 14 03:34:07 user nova-compute[74836]:   <memory unit='KiB'>524288</memory>
Nov 14 03:34:07 user nova-compute[74836]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 03:34:07 user nova-compute[74836]:   <vcpu placement='static'>1</vcpu>
Nov 14 03:34:07 user nova-compute[74836]:   <resource>
Nov 14 03:34:07 user nova-compute[74836]:     <partition>/machine</partition>
Nov 14 03:34:07 user nova-compute[74836]:   </resource>
Nov 14 03:34:07 user nova-compute[74836]:   <sysinfo type='smbios'>
Nov 14 03:34:07 user nova-compute[74836]:     <system>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='version'>0.0.0</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='serial'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='uuid'>93de60b4-700f-4284-a8d9-73130522d402</entry>
Nov 14 03:34:07 user nova-compute[74836]:       <entry name='family'>Virtual Machine</entry>
Nov 14 03:34:07 user nova-compute[74836]:     </system>
Nov 14 03:34:07 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:07 user nova-compute[74836]:   <os>
Nov 14 03:34:07 user nova-compute[74836]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 03:34:07 user nova-compute[74836]:     <boot dev='hd'/>
Nov 14 03:34:07 user nova-compute[74836]:     <smbios mode='sysinfo'/>
Nov 14 03:34:07 user nova-compute[74836]:   </os>
Nov 14 03:34:07 user nova-compute[74836]:   <features>
Nov 14 03:34:07 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:07 user nova-compute[74836]:     <apic/>
Nov 14 03:34:07 user nova-compute[74836]:     <vmcoreinfo state='on'/>
Nov 14 03:34:07 user nova-compute[74836]:   </features>
Nov 14 03:34:07 user nova-compute[74836]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 03:34:07 user nova-compute[74836]:     <model fallback='forbid'>Nehalem</model>
Nov 14 03:34:07 user nova-compute[74836]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='vme'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='x2apic'/>
Nov 14 03:34:07 user nova-compute[74836]:     <feature policy='require' name='hypervisor'/>
Nov 14 03:34:07 user nova-compute[74836]:   </cpu>
Nov 14 03:34:07 user nova-compute[74836]:   <clock offset='utc'>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 03:34:07 user nova-compute[74836]:     <timer name='hpet' present='no'/>
Nov 14 03:34:07 user nova-compute[74836]:   </clock>
Nov 14 03:34:07 user nova-compute[74836]:   <on_poweroff>destroy</on_poweroff>
Nov 14 03:34:07 user nova-compute[74836]:   <on_reboot>restart</on_reboot>
Nov 14 03:34:07 user nova-compute[74836]:   <on_crash>destroy</on_crash>
Nov 14 03:34:07 user nova-compute[74836]:   <devices>
Nov 14 03:34:07 user nova-compute[74836]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 03:34:07 user nova-compute[74836]:     <disk type='file' device='disk'>
Nov 14 03:34:07 user nova-compute[74836]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 03:34:07 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk' index='2'/>
Nov 14 03:34:07 user nova-compute[74836]:       <backingStore type='file' index='3'>
Nov 14 03:34:07 user nova-compute[74836]:         <format type='raw'/>
Nov 14 03:34:07 user nova-compute[74836]:         <source file='/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5'/>
Nov 14 03:34:07 user nova-compute[74836]:         <backingStore/>
Nov 14 03:34:07 user nova-compute[74836]:       </backingStore>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='vda' bus='virtio'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='virtio-disk0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </disk>
Nov 14 03:34:07 user nova-compute[74836]:     <disk type='file' device='cdrom'>
Nov 14 03:34:07 user nova-compute[74836]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 03:34:07 user nova-compute[74836]:       <source file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/disk.config' index='1'/>
Nov 14 03:34:07 user nova-compute[74836]:       <backingStore/>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='hda' bus='ide'/>
Nov 14 03:34:07 user nova-compute[74836]:       <readonly/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='ide0-0-0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </disk>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='usb' index='0' model='none'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='usb'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='pci.0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <controller type='ide' index='0'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='ide'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 03:34:07 user nova-compute[74836]:     </controller>
Nov 14 03:34:07 user nova-compute[74836]:     <interface type='ethernet'>
Nov 14 03:34:07 user nova-compute[74836]:       <mac address='fa:16:3e:d9:ea:94'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target dev='tapc2f23a72-65'/>
Nov 14 03:34:07 user nova-compute[74836]:       <model type='virtio'/>
Nov 14 03:34:07 user nova-compute[74836]:       <mtu size='1442'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='net0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </interface>
Nov 14 03:34:07 user nova-compute[74836]:     <serial type='pty'>
Nov 14 03:34:07 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:07 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target type='isa-serial' port='0'>
Nov 14 03:34:07 user nova-compute[74836]:         <model name='isa-serial'/>
Nov 14 03:34:07 user nova-compute[74836]:       </target>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </serial>
Nov 14 03:34:07 user nova-compute[74836]:     <console type='pty' tty='/dev/pts/9'>
Nov 14 03:34:07 user nova-compute[74836]:       <source path='/dev/pts/9'/>
Nov 14 03:34:07 user nova-compute[74836]:       <log file='/opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402/console.log' append='off'/>
Nov 14 03:34:07 user nova-compute[74836]:       <target type='serial' port='0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='serial0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </console>
Nov 14 03:34:07 user nova-compute[74836]:     <input type='mouse' bus='ps2'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='input0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </input>
Nov 14 03:34:07 user nova-compute[74836]:     <input type='keyboard' bus='ps2'>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='input1'/>
Nov 14 03:34:07 user nova-compute[74836]:     </input>
Nov 14 03:34:07 user nova-compute[74836]:     <graphics type='vnc' port='5909' autoport='yes' listen='0.0.0.0'>
Nov 14 03:34:07 user nova-compute[74836]:       <listen type='address' address='0.0.0.0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </graphics>
Nov 14 03:34:07 user nova-compute[74836]:     <audio id='1' type='none'/>
Nov 14 03:34:07 user nova-compute[74836]:     <video>
Nov 14 03:34:07 user nova-compute[74836]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='video0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </video>
Nov 14 03:34:07 user nova-compute[74836]:     <memballoon model='virtio'>
Nov 14 03:34:07 user nova-compute[74836]:       <stats period='10'/>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='balloon0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:07 user nova-compute[74836]:     <rng model='virtio'>
Nov 14 03:34:07 user nova-compute[74836]:       <backend model='random'>/dev/urandom</backend>
Nov 14 03:34:07 user nova-compute[74836]:       <alias name='rng0'/>
Nov 14 03:34:07 user nova-compute[74836]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 03:34:07 user nova-compute[74836]:     </rng>
Nov 14 03:34:07 user nova-compute[74836]:   </devices>
Nov 14 03:34:07 user nova-compute[74836]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 03:34:07 user nova-compute[74836]:     <label>libvirt-93de60b4-700f-4284-a8d9-73130522d402</label>
Nov 14 03:34:07 user nova-compute[74836]:     <imagelabel>libvirt-93de60b4-700f-4284-a8d9-73130522d402</imagelabel>
Nov 14 03:34:07 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:07 user nova-compute[74836]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 03:34:07 user nova-compute[74836]:     <label>+64055:+108</label>
Nov 14 03:34:07 user nova-compute[74836]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 03:34:07 user nova-compute[74836]:   </seclabel>
Nov 14 03:34:07 user nova-compute[74836]: </domain>
Nov 14 03:34:07 user nova-compute[74836]:  {{(pid=74836) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 03:34:07 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Detaching interface fa:16:3e:92:8f:85 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapae83c070-b1' not found.
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Converting VIF {"id": "ae83c070-b163-40c6-8e52-7b71714f30c7", "address": "fa:16:3e:92:8f:85", "network": {"id": "9ec40f7f-0f00-4ed8-ae48-40b8a293a375", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-441240069", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae83c070-b1", "ovs_interfaceid": "ae83c070-b163-40c6-8e52-7b71714f30c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG os_vif [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae83c070-b1, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:34:07 user nova-compute[74836]: INFO os_vif [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8f:85,bridge_name='br-int',has_traffic_filtering=True,id=ae83c070-b163-40c6-8e52-7b71714f30c7,network=Network(9ec40f7f-0f00-4ed8-ae48-40b8a293a375),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae83c070-b1')
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [req-e3f22915-238b-40e2-93ce-84d8659d76cc req-3d83e684-4d0a-4e51-9e04-04dc74cd1d9b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:07 user nova-compute[74836]:   <nova:package version="0.0.0"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:name>tempest-device-tagging-server-309062577</nova:name>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:creationTime>2023-11-14 03:34:07</nova:creationTime>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:flavor name="m1.tiny">
Nov 14 03:34:07 user nova-compute[74836]:     <nova:memory>512</nova:memory>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:disk>1</nova:disk>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:swap>0</nova:swap>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:flavor>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:user uuid="9bb4bac46228411d958d4df9fa54b82b">tempest-TaggedAttachmentsTest-1526356192-project-member</nova:user>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:project uuid="1f166a74a4e54512b8d727d6a7648df5">tempest-TaggedAttachmentsTest-1526356192</nova:project>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:owner>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:07 user nova-compute[74836]:   <nova:ports>
Nov 14 03:34:07 user nova-compute[74836]:     <nova:port uuid="c2f23a72-6538-48c5-b99b-e85a17a513fb">
Nov 14 03:34:07 user nova-compute[74836]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:34:07 user nova-compute[74836]:     </nova:port>
Nov 14 03:34:07 user nova-compute[74836]:   </nova:ports>
Nov 14 03:34:07 user nova-compute[74836]: </nova:instance>
Nov 14 03:34:07 user nova-compute[74836]:  {{(pid=74836) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [{"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Releasing lock "refresh_cache-93de60b4-700f-4284-a8d9-73130522d402" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1c6285f5-4cb2-4f1b-acd8-0419b8f64852 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "interface-93de60b4-700f-4284-a8d9-73130522d402-ae83c070-b163-40c6-8e52-7b71714f30c7" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.363s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:34:09 user nova-compute[74836]: INFO nova.compute.claims [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Claim successful on node user
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing instance network info cache due to event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:09 user nova-compute[74836]: INFO nova.compute.manager [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Terminating instance
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:34:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updated VIF entry in instance network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-68646db6-9397-4c1e-9302-042ffcf95cee req-39e81c92-443f-4dcf-ac09-2a5e448c93b1 service nova] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.policy [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b140c51aa00346a087a73f715872fbff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f22b90ab4b5f44cd8bb9a796ea8a4c7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:34:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Creating image(s)
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "/opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "/opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Instance destroyed successfully.
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lazy-loading 'resources' on Instance uuid 56d5cc32-4db6-47c7-9e55-10a01c771c17 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1263424773',display_name='tempest-VolumesAssistedSnapshotsTest-server-1263424773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1263424773',id=9,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdn9dqya9Sdvy0luAx9Gy1+zLJ/X+cqDQP6RyuEmL1CRCMGkg0JtQ9OQsgs0oRUE4SRksBWHNZVeNoiDb6oic8p9ZwWWBtpag6RFefyqLkSg1fPgyXRzlhYi2RB4AlNYA==',key_name='tempest-keypair-1864994356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='491c715ecd0248099544356e775044d8',ramdisk_id='',reservation_id='r-6q7cxelp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1912561792',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1912561792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16a50580518a437a9743ec1ad6c05ad1',uuid=56d5cc32-4db6-47c7-9e55-10a01c771c17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converting VIF {"id": "79ce1783-30d6-4807-a2bc-5811999bce54", "address": "fa:16:3e:de:68:7b", "network": {"id": "45cd444c-de15-454b-beb8-4125502522a6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1866078942-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "491c715ecd0248099544356e775044d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ce1783-30", "ovs_interfaceid": "79ce1783-30d6-4807-a2bc-5811999bce54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG os_vif [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79ce1783-30, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=391e4e22-3ba0-4d2a-928d-ce42d148026e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:10 user nova-compute[74836]: INFO os_vif [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:68:7b,bridge_name='br-int',has_traffic_filtering=True,id=79ce1783-30d6-4807-a2bc-5811999bce54,network=Network(45cd444c-de15-454b-beb8-4125502522a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ce1783-30')
Nov 14 03:34:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Deleting instance files /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17_del
Nov 14 03:34:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Deletion of /opt/stack/data/nova/instances/56d5cc32-4db6-47c7-9e55-10a01c771c17_del complete
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk 1073741824" returned: 0 in 0.095s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:10 user nova-compute[74836]: INFO nova.compute.manager [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Successfully created port: dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Cannot resize image /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Ensure instance console log exists: /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Successfully updated port: dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-unplugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] No waiting events found dispatching network-vif-unplugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-unplugged-79ce1783-30d6-4807-a2bc-5811999bce54 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Acquiring lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] No waiting events found dispatching network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:11 user nova-compute[74836]: WARNING nova.compute.manager [req-49521de5-7ca0-4a86-8a3c-5bea52248322 req-2717b60d-6ff9-44d3-8f22-b6b2d417d084 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received unexpected event network-vif-plugged-79ce1783-30d6-4807-a2bc-5811999bce54 for instance with vm_state active and task_state deleting.
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquired lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:11 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Took 1.17 seconds to deallocate network for instance.
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-1675f6b8-3583-47d6-97a7-bd59feeed7c4 req-966d9a52-5e57-471b-a16b-448c080ffd35 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Received event network-vif-deleted-79ce1783-30d6-4807-a2bc-5811999bce54 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:11 user nova-compute[74836]: INFO nova.compute.manager [req-1675f6b8-3583-47d6-97a7-bd59feeed7c4 req-966d9a52-5e57-471b-a16b-448c080ffd35 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Neutron deleted interface 79ce1783-30d6-4807-a2bc-5811999bce54; detaching it from the instance and deleting it from the info cache
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-1675f6b8-3583-47d6-97a7-bd59feeed7c4 req-966d9a52-5e57-471b-a16b-448c080ffd35 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-1675f6b8-3583-47d6-97a7-bd59feeed7c4 req-966d9a52-5e57-471b-a16b-448c080ffd35 service nova] [instance: 56d5cc32-4db6-47c7-9e55-10a01c771c17] Detach interface failed, port_id=79ce1783-30d6-4807-a2bc-5811999bce54, reason: Instance 56d5cc32-4db6-47c7-9e55-10a01c771c17 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Updating instance_info_cache with network_info: [{"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Releasing lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Instance network_info: |[{"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Start _get_guest_xml network_info=[{"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:34:11 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:11 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797110830',display_name='tempest-VolumesAdminNegativeTest-server-797110830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797110830',id=16,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-3vflyawa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:10Z,user_data=None,user_id='b140c51aa00346a087a73f715872fbff',uuid=cc11bfda-4409-4b64-b4fe-be8acc05cf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'pci_devices' on Instance uuid cc11bfda-4409-4b64-b4fe-be8acc05cf16 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:34:11 user nova-compute[74836]:   <uuid>cc11bfda-4409-4b64-b4fe-be8acc05cf16</uuid>
Nov 14 03:34:11 user nova-compute[74836]:   <name>instance-00000010</name>
Nov 14 03:34:11 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:34:11 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:34:11 user nova-compute[74836]:   <metadata>
Nov 14 03:34:11 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:11 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:name>tempest-VolumesAdminNegativeTest-server-797110830</nova:name>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:34:11</nova:creationTime>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:34:11 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:11 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:owner>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:user uuid="b140c51aa00346a087a73f715872fbff">tempest-VolumesAdminNegativeTest-2038430318-project-member</nova:user>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:project uuid="f22b90ab4b5f44cd8bb9a796ea8a4c7e">tempest-VolumesAdminNegativeTest-2038430318</nova:project>
Nov 14 03:34:11 user nova-compute[74836]:       </nova:owner>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:11 user nova-compute[74836]:       <nova:ports>
Nov 14 03:34:11 user nova-compute[74836]:         <nova:port uuid="dfde399e-0335-4d95-8748-78208e219b15">
Nov 14 03:34:11 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:34:11 user nova-compute[74836]:         </nova:port>
Nov 14 03:34:11 user nova-compute[74836]:       </nova:ports>
Nov 14 03:34:11 user nova-compute[74836]:     </nova:instance>
Nov 14 03:34:11 user nova-compute[74836]:   </metadata>
Nov 14 03:34:11 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:34:11 user nova-compute[74836]:     <system>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="serial">cc11bfda-4409-4b64-b4fe-be8acc05cf16</entry>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="uuid">cc11bfda-4409-4b64-b4fe-be8acc05cf16</entry>
Nov 14 03:34:11 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:34:11 user nova-compute[74836]:     </system>
Nov 14 03:34:11 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:11 user nova-compute[74836]:   <os>
Nov 14 03:34:11 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:34:11 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:34:11 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:34:11 user nova-compute[74836]:   </os>
Nov 14 03:34:11 user nova-compute[74836]:   <features>
Nov 14 03:34:11 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:11 user nova-compute[74836]:     <apic/>
Nov 14 03:34:11 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:34:11 user nova-compute[74836]:   </features>
Nov 14 03:34:11 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:34:11 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:34:11 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:34:11 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:34:11 user nova-compute[74836]:   </clock>
Nov 14 03:34:11 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:34:11 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:34:11 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:34:11 user nova-compute[74836]:   </cpu>
Nov 14 03:34:11 user nova-compute[74836]:   <devices>
Nov 14 03:34:11 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:34:11 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:34:11 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk"/>
Nov 14 03:34:11 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:34:11 user nova-compute[74836]:     </disk>
Nov 14 03:34:11 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:34:11 user nova-compute[74836]:       <mac address="fa:16:3e:a3:81:13"/>
Nov 14 03:34:11 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:11 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:34:11 user nova-compute[74836]:       <target dev="tapdfde399e-03"/>
Nov 14 03:34:11 user nova-compute[74836]:     </interface>
Nov 14 03:34:11 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:34:11 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/console.log" append="off"/>
Nov 14 03:34:11 user nova-compute[74836]:     </serial>
Nov 14 03:34:11 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:34:11 user nova-compute[74836]:     <video>
Nov 14 03:34:11 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:11 user nova-compute[74836]:     </video>
Nov 14 03:34:11 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:34:11 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:34:11 user nova-compute[74836]:     </rng>
Nov 14 03:34:11 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:34:11 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:34:11 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:34:11 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:11 user nova-compute[74836]:   </devices>
Nov 14 03:34:11 user nova-compute[74836]: </domain>
Nov 14 03:34:11 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797110830',display_name='tempest-VolumesAdminNegativeTest-server-797110830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797110830',id=16,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-3vflyawa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:10Z,user_data=None,user_id='b140c51aa00346a087a73f715872fbff',uuid=cc11bfda-4409-4b64-b4fe-be8acc05cf16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG os_vif [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6692e0e-2708-5ef2-9559-a1516e270d14', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfde399e-03, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfde399e-03, col_values=(('qos', UUID('41b66a50-197d-4762-b0c7-3cb379159076')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfde399e-03, col_values=(('external_ids', {'iface-id': 'dfde399e-0335-4d95-8748-78208e219b15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:81:13', 'vm-uuid': 'cc11bfda-4409-4b64-b4fe-be8acc05cf16'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:11 user nova-compute[74836]: INFO os_vif [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03')
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] No VIF found with MAC fa:16:3e:a3:81:13, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:12 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Deleted allocations for instance 56d5cc32-4db6-47c7-9e55-10a01c771c17
Nov 14 03:34:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a084b647-b3e9-4692-9795-72712b497fee tempest-VolumesAssistedSnapshotsTest-1912561792 tempest-VolumesAssistedSnapshotsTest-1912561792-project-member] Lock "56d5cc32-4db6-47c7-9e55-10a01c771c17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.967s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing instance network info cache due to event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updated VIF entry in instance network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d5472d7-044d-45d0-9861-af8b2b3a6ecc req-e32381b6-f975-422d-bf83-05d9434b2741 service nova] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-changed-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Refreshing instance network info cache due to event network-changed-dfde399e-0335-4d95-8748-78208e219b15. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] Acquiring lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] Acquired lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Refreshing network info cache for port dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Updated VIF entry in instance network info cache for port dfde399e-0335-4d95-8748-78208e219b15. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Updating instance_info_cache with network_info: [{"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-480776ef-9943-4c86-9019-1d60beae5361 req-11eb9350-e7c9-4380-8fbe-576258d5b300 service nova] Releasing lock "refresh_cache-cc11bfda-4409-4b64-b4fe-be8acc05cf16" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] No waiting events found dispatching network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:14 user nova-compute[74836]: WARNING nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received unexpected event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 for instance with vm_state building and task_state spawning.
Nov 14 03:34:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] No waiting events found dispatching network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:14 user nova-compute[74836]: WARNING nova.compute.manager [req-b1f04262-24c0-440c-96d3-dd9951b98329 req-402f3f86-a15f-4bce-ab07-132b0b368a3b service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received unexpected event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 for instance with vm_state building and task_state spawning.
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:14 user nova-compute[74836]: INFO nova.compute.manager [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Rebooting instance
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:15 user nova-compute[74836]: WARNING nova.compute.manager [req-faa588c8-82b3-49c0-82c7-94719dd57b63 req-4103fbd0-8382-43d2-9044-a4b7c9a5b3bc service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:34:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Instance spawned successfully.
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:15 user nova-compute[74836]: INFO nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 03:34:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:34:15 user nova-compute[74836]: INFO nova.compute.manager [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Took 6.63 seconds to build instance.
Nov 14 03:34:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3212d10c-b658-4b15-97bd-4cf594f08b7f tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.718s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance destroyed successfully.
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'resources' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:34:15Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb74e63c-4b, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=306226af-ae82-4b58-b579-9518a2f4180e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: INFO os_vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b')
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:34:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[575cb89c-21e3-450c-b8fd-8a54c4423da5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:34:16 user nova-compute[74836]: No targets found.
Nov 14 03:34:16 user nova-compute[74836]: iSNS:
Nov 14 03:34:16 user nova-compute[74836]: No targets found.
Nov 14 03:34:16 user nova-compute[74836]: STATIC:
Nov 14 03:34:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c
Nov 14 03:34:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:34:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:34:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:34:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:34:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:34:16 user nova-compute[74836]: FIRMWARE:
Nov 14 03:34:16 user nova-compute[74836]: No targets found.
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:34:16 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:34:16 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d22884-c4e4-451b-9962-0f69f247c815]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0659ebd5-57bb-439d-9b62-87547ae9cd79]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43ba290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415a2b9-2626-42dc-8d35-044bac70309a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a4adc2-5330-41c4-a6ca-f7d952764a70]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0da89d-76b5-4165-a98f-f897dec9b394]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2636754-7801-4e26-9230-9f215683d2b2]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c299ba1-5065-4d0a-9b82-6bd4b86f8762]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2335d-4009-4d72-9479-9e779e33158d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]
Nov 14 03:34:16 user nova-compute[74836]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adf002-11d1-4220-9c01-3c95dda606d0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== disconnect_volume: return (336ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start _get_guest_xml network_info=[{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce8c25fb-ee6b-4f80-b055-86191a9c8143,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': 'ce8c25fb-ee6b-4f80-b055-86191a9c8143'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '511e8759-a397-4300-9925-6fdf53a1631d', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'serial': 'fb1a41e7-8a76-42f0-b7c8-d7181fd3521c'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '497d231c-b208-470e-9a93-97bba2392f9e', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:34:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=ce8c25fb-ee6b-4f80-b055-86191a9c8143,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'vcpu_model' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Object Instance<511e8759-a397-4300-9925-6fdf53a1631d> lazy-loaded attributes: resources,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:34:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:34:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:34:16 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce8171-d1d0-4992-b466-5fd472a7a2e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:34:16 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f25adb7-aaf6-43e1-aac1-5741f7571f14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c] added
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d0237a-4362-492f-a687-3ae0be4a893a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c10021d-0c7f-431b-a6df-36d3b6572107]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuIqbcjJ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MuIqbcjJ" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7b15df-5c66-47aa-81e0-bc3c3c4a8472]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MuIqbcjJ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9785b7e7-a8ec-42f3-9dc3-898a25c88b3c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f4b642-12ee-4e57-83b1-b2ab4d1df650]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[135c028d-4a86-4861-9d37-e370168b2463]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]
Nov 14 03:34:16 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e28eeaf-90fd-46fd-aa4b-ab9aa95c2216]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f36d1-5581-4e5d-b132-5803f5df6772]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:34:16 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:34:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5130f53-e9ff-44b8-b1bf-e62a5cae674f]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:34:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:17 user nova-compute[74836]: WARNING nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:17 user nova-compute[74836]: WARNING nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:17 user nova-compute[74836]: WARNING nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:17 user nova-compute[74836]: WARNING nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:17 user nova-compute[74836]: WARNING nova.compute.manager [req-9e805cca-98dd-43de-9751-7c22a5c4e656 req-9aa95b2d-301b-4f30-b691-bb0be7839343 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26662623436323865', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623436323865', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:34:15Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'pci_devices' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.objects.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Object Instance<511e8759-a397-4300-9925-6fdf53a1631d> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:34:17 user nova-compute[74836]:   <uuid>511e8759-a397-4300-9925-6fdf53a1631d</uuid>
Nov 14 03:34:17 user nova-compute[74836]:   <name>instance-0000000d</name>
Nov 14 03:34:17 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:34:17 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:34:17 user nova-compute[74836]:   <metadata>
Nov 14 03:34:17 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:17 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:name>tempest-TestMinimumBasicScenario-server-1817550384</nova:name>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:34:16</nova:creationTime>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:34:17 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:17 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:owner>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:user uuid="f7460cb84c194287b1bcbf512bd98ff5">tempest-TestMinimumBasicScenario-84832661-project-member</nova:user>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:project uuid="a2c60d13f8c14f9a9849ba536a716032">tempest-TestMinimumBasicScenario-84832661</nova:project>
Nov 14 03:34:17 user nova-compute[74836]:       </nova:owner>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:root type="image" uuid="ce8c25fb-ee6b-4f80-b055-86191a9c8143"/>
Nov 14 03:34:17 user nova-compute[74836]:       <nova:ports>
Nov 14 03:34:17 user nova-compute[74836]:         <nova:port uuid="db74e63c-4b75-41e6-bcb2-20955d2e6da4">
Nov 14 03:34:17 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:34:17 user nova-compute[74836]:         </nova:port>
Nov 14 03:34:17 user nova-compute[74836]:       </nova:ports>
Nov 14 03:34:17 user nova-compute[74836]:     </nova:instance>
Nov 14 03:34:17 user nova-compute[74836]:   </metadata>
Nov 14 03:34:17 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:34:17 user nova-compute[74836]:     <system>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="serial">511e8759-a397-4300-9925-6fdf53a1631d</entry>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="uuid">511e8759-a397-4300-9925-6fdf53a1631d</entry>
Nov 14 03:34:17 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:34:17 user nova-compute[74836]:     </system>
Nov 14 03:34:17 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:17 user nova-compute[74836]:   <os>
Nov 14 03:34:17 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:34:17 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:34:17 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:34:17 user nova-compute[74836]:   </os>
Nov 14 03:34:17 user nova-compute[74836]:   <features>
Nov 14 03:34:17 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:17 user nova-compute[74836]:     <apic/>
Nov 14 03:34:17 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:34:17 user nova-compute[74836]:   </features>
Nov 14 03:34:17 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:34:17 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:34:17 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:34:17 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:34:17 user nova-compute[74836]:   </clock>
Nov 14 03:34:17 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:34:17 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:34:17 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:34:17 user nova-compute[74836]:   </cpu>
Nov 14 03:34:17 user nova-compute[74836]:   <devices>
Nov 14 03:34:17 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:34:17 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:34:17 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk"/>
Nov 14 03:34:17 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:34:17 user nova-compute[74836]:     </disk>
Nov 14 03:34:17 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:34:17 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:34:17 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:34:17 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:34:17 user nova-compute[74836]:       <serial>fb1a41e7-8a76-42f0-b7c8-d7181fd3521c</serial>
Nov 14 03:34:17 user nova-compute[74836]:     </disk>
Nov 14 03:34:17 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:34:17 user nova-compute[74836]:       <mac address="fa:16:3e:2f:96:1b"/>
Nov 14 03:34:17 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:17 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:34:17 user nova-compute[74836]:       <target dev="tapdb74e63c-4b"/>
Nov 14 03:34:17 user nova-compute[74836]:     </interface>
Nov 14 03:34:17 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:34:17 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/console.log" append="off"/>
Nov 14 03:34:17 user nova-compute[74836]:     </serial>
Nov 14 03:34:17 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:34:17 user nova-compute[74836]:     <video>
Nov 14 03:34:17 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:17 user nova-compute[74836]:     </video>
Nov 14 03:34:17 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:34:17 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:34:17 user nova-compute[74836]:     </rng>
Nov 14 03:34:17 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:34:17 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:34:17 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:34:17 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:17 user nova-compute[74836]:   </devices>
Nov 14 03:34:17 user nova-compute[74836]: </domain>
Nov 14 03:34:17 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:34:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'trusted_certs' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.objects.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Object Instance<511e8759-a397-4300-9925-6fdf53a1631d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Cannot resize image /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'migration_context' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.objects.base [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Object Instance<511e8759-a397-4300-9925-6fdf53a1631d> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:15Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG os_vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fce4cd7c-d9a6-5b60-b0cc-2f5e484cd61d', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb74e63c-4b, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb74e63c-4b, col_values=(('qos', UUID('c3b2bfde-9120-4eb8-abaf-45c1aa0027a8')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb74e63c-4b, col_values=(('external_ids', {'iface-id': 'db74e63c-4b75-41e6-bcb2-20955d2e6da4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:96:1b', 'vm-uuid': '511e8759-a397-4300-9925-6fdf53a1631d'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:18 user nova-compute[74836]: INFO os_vif [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b')
Nov 14 03:34:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:20 user nova-compute[74836]: WARNING nova.compute.manager [req-d569ef5f-05b5-4893-8f32-f02a316a43aa req-12215a9a-7f52-4895-ae8b-b75fec823da5 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:22 user nova-compute[74836]: WARNING nova.compute.manager [req-86ee046b-5d28-47f0-b201-81ae6f75cccf req-036451a3-f55b-4b6c-a24f-007420534691 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 03:34:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:34:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance rebooted successfully.
Nov 14 03:34:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:34:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8446b5ad-179f-403b-9722-430be4990980 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.332s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:28 user nova-compute[74836]: INFO nova.compute.manager [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Terminating instance
Nov 14 03:34:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-unplugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] No waiting events found dispatching network-vif-unplugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a294122-5bd5-492d-aba6-9ef8d9cc9eab req-80c1853d-0959-4864-bea7-e4aadc6276b1 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-unplugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:28 user nova-compute[74836]: INFO nova.compute.manager [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Terminating instance
Nov 14 03:34:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Instance destroyed successfully.
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lazy-loading 'resources' on Instance uuid 28e19196-80cc-4f64-9444-546a29180fb4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1901248885',display_name='tempest-ServersNegativeTestJSON-server-1901248885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1901248885',id=14,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-hofkc9l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:45Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=28e19196-80cc-4f64-9444-546a29180fb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "address": "fa:16:3e:25:f4:6b", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap555e29fa-7e", "ovs_interfaceid": "555e29fa-7e6c-45e5-ad95-f8d062d53e09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG os_vif [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap555e29fa-7e, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ea49a41-409c-40ec-ba00-3524945485f1) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: INFO os_vif [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:f4:6b,bridge_name='br-int',has_traffic_filtering=True,id=555e29fa-7e6c-45e5-ad95-f8d062d53e09,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap555e29fa-7e')
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Deleting instance files /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4_del
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Deletion of /opt/stack/data/nova/instances/28e19196-80cc-4f64-9444-546a29180fb4_del complete
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.compute.manager [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 03:34:29 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Instance destroyed successfully.
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lazy-loading 'resources' on Instance uuid f197c8c0-6f1b-4b38-93fc-309e598a4eb6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-462570854',display_name='tempest-TestVolumeSwap-server-462570854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-462570854',id=7,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHpcyyoFS/Z+11JnxXFp1NRg/FBmOfhGUF7tQILoBc3t84pj3VP7m7OfxGSolmL9x5R3QhfigD33EUnYZqeAo0Qw+y5pnpb9gVVpmGFMNeAcKDk93oopyY3raFffhuqZg==',key_name='tempest-keypair-1355804785',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5408be71c29b4403a7056c0323d23e3d',ramdisk_id='',reservation_id='r-jxc4c1ml',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1733835192',owner_user_name='tempest-TestVolumeSwap-1733835192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e50f7a1efbbb42918795aaa6f67b04f9',uuid=f197c8c0-6f1b-4b38-93fc-309e598a4eb6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converting VIF {"id": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "address": "fa:16:3e:08:96:a9", "network": {"id": "4fe8d688-4ee8-4379-9203-d8e19312d6b6", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1782536692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5408be71c29b4403a7056c0323d23e3d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa53f7b05-85", "ovs_interfaceid": "a53f7b05-8589-4d3f-9fb5-91dd0183e561", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG os_vif [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa53f7b05-85, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aff6126-b51c-41c3-9f05-25ca79becd88) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:29 user nova-compute[74836]: INFO os_vif [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:96:a9,bridge_name='br-int',has_traffic_filtering=True,id=a53f7b05-8589-4d3f-9fb5-91dd0183e561,network=Network(4fe8d688-4ee8-4379-9203-d8e19312d6b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa53f7b05-85')
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Deleting instance files /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6_del
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Deletion of /opt/stack/data/nova/instances/f197c8c0-6f1b-4b38-93fc-309e598a4eb6_del complete
Nov 14 03:34:29 user nova-compute[74836]: INFO nova.compute.manager [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 14 03:34:29 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:34:29 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:30 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Took 1.21 seconds to deallocate network for instance.
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-22a58a0e-dd78-497c-8a6f-2e86a92f7ce3 req-95523803-1a1f-421e-a955-2367e60d000f service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-deleted-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Acquiring lock "28e19196-80cc-4f64-9444-546a29180fb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "28e19196-80cc-4f64-9444-546a29180fb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] No waiting events found dispatching network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:30 user nova-compute[74836]: WARNING nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: 28e19196-80cc-4f64-9444-546a29180fb4] Received unexpected event network-vif-plugged-555e29fa-7e6c-45e5-ad95-f8d062d53e09 for instance with vm_state deleted and task_state None.
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-unplugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] No waiting events found dispatching network-vif-unplugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-unplugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Acquiring lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] No waiting events found dispatching network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:30 user nova-compute[74836]: WARNING nova.compute.manager [req-e65903f8-7b27-4200-8f5b-dd7f591d7baa req-d42fb876-77de-4af6-aa95-d2911aa6bfd9 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received unexpected event network-vif-plugged-a53f7b05-8589-4d3f-9fb5-91dd0183e561 for instance with vm_state active and task_state deleting.
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:30 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Took 0.86 seconds to deallocate network for instance.
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-3701d56f-238c-4b01-9db5-1b36c3bd4d24 req-5c2335a0-871b-403f-bb4b-50900b6152f4 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Received event network-vif-deleted-a53f7b05-8589-4d3f-9fb5-91dd0183e561 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:30 user nova-compute[74836]: INFO nova.compute.manager [req-3701d56f-238c-4b01-9db5-1b36c3bd4d24 req-5c2335a0-871b-403f-bb4b-50900b6152f4 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Neutron deleted interface a53f7b05-8589-4d3f-9fb5-91dd0183e561; detaching it from the instance and deleting it from the info cache
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.network.neutron [req-3701d56f-238c-4b01-9db5-1b36c3bd4d24 req-5c2335a0-871b-403f-bb4b-50900b6152f4 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-3701d56f-238c-4b01-9db5-1b36c3bd4d24 req-5c2335a0-871b-403f-bb4b-50900b6152f4 service nova] [instance: f197c8c0-6f1b-4b38-93fc-309e598a4eb6] Detach interface failed, port_id=a53f7b05-8589-4d3f-9fb5-91dd0183e561, reason: Instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.172s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:30 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Deleted allocations for instance 28e19196-80cc-4f64-9444-546a29180fb4
Nov 14 03:34:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-673c6b3d-a65b-462a-a0b4-365d48ff4234 tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "28e19196-80cc-4f64-9444-546a29180fb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:31 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:31 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:31 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Deleted allocations for instance f197c8c0-6f1b-4b38-93fc-309e598a4eb6
Nov 14 03:34:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8d254218-7497-45fc-85fb-be966fd3fc55 tempest-TestVolumeSwap-1733835192 tempest-TestVolumeSwap-1733835192-project-member] Lock "f197c8c0-6f1b-4b38-93fc-309e598a4eb6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "93de60b4-700f-4284-a8d9-73130522d402-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:36 user nova-compute[74836]: INFO nova.compute.manager [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Terminating instance
Nov 14 03:34:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:34:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Instance destroyed successfully.
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lazy-loading 'resources' on Instance uuid 93de60b4-700f-4284-a8d9-73130522d402 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:31:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-309062577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-309062577',id=10,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK4czf3Tzrn7qlHrkgqouUGywgPhkTXlvao9WgZHEIc589qHJv5oledq+ByKFxKbbD+sfs0/owanuafPnxAd9MHWE2VqWVEjN6dAvTFLSyd+kUcDRLHq1uoVIeEc90FRTA==',key_name='tempest-keypair-1557881770',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f166a74a4e54512b8d727d6a7648df5',ramdisk_id='',reservation_id='r-touluqaz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1526356192',owner_user_name='tempest-TaggedAttachmentsTest-1526356192-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9bb4bac46228411d958d4df9fa54b82b',uuid=93de60b4-700f-4284-a8d9-73130522d402,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converting VIF {"id": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "address": "fa:16:3e:d9:ea:94", "network": {"id": "85be1621-5cd0-4e56-8c7e-2e00d3b2ab11", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-589979194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f166a74a4e54512b8d727d6a7648df5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2f23a72-65", "ovs_interfaceid": "c2f23a72-6538-48c5-b99b-e85a17a513fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG os_vif [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2f23a72-65, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57d4ae7a-0996-4df9-89ae-cfb5a731730d) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:37 user nova-compute[74836]: INFO os_vif [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:ea:94,bridge_name='br-int',has_traffic_filtering=True,id=c2f23a72-6538-48c5-b99b-e85a17a513fb,network=Network(85be1621-5cd0-4e56-8c7e-2e00d3b2ab11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2f23a72-65')
Nov 14 03:34:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Deleting instance files /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402_del
Nov 14 03:34:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Deletion of /opt/stack/data/nova/instances/93de60b4-700f-4284-a8d9-73130522d402_del complete
Nov 14 03:34:37 user nova-compute[74836]: INFO nova.compute.manager [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 14 03:34:37 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:34:37 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:39 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Took 1.36 seconds to deallocate network for instance.
Nov 14 03:34:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-8eb8a201-6f2c-4a75-be5d-8e7b441780a5 req-d4efd3ed-4760-46cb-acd2-eaf8b43186c0 service nova] [instance: 93de60b4-700f-4284-a8d9-73130522d402] Received event network-vif-deleted-c2f23a72-6538-48c5-b99b-e85a17a513fb {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:39 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Deleted allocations for instance 93de60b4-700f-4284-a8d9-73130522d402
Nov 14 03:34:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3d4703de-ea7f-4978-a4b5-6ff296be3d99 tempest-TaggedAttachmentsTest-1526356192 tempest-TaggedAttachmentsTest-1526356192-project-member] Lock "93de60b4-700f-4284-a8d9-73130522d402" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.020s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:34:40 user nova-compute[74836]: INFO nova.compute.claims [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Claim successful on node user
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:34:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:34:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Creating image(s)
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG nova.policy [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9aff38e58fe4a1b8bd4d46ceda55ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e7a009680c4c6d80ab5bb26d05b100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk 1073741824" returned: 0 in 0.055s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Cannot resize image /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Ensure instance console log exists: /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Successfully created port: b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:34:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:43 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Successfully updated port: b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-changed-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Refreshing instance network info cache due to event network-changed-b5f1b174-ff03-4f85-9de9-caf34175b732. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] Acquiring lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating instance_info_cache with network_info: [{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance network_info: |[{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] Acquired lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.neutron [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Refreshing network info cache for port b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start _get_guest_xml network_info=[{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:34:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-tempest.common.compute-instance-2025290862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'pci_devices' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:34:45 user nova-compute[74836]:   <uuid>c340e46d-8444-46be-a47f-13e9b91698a4</uuid>
Nov 14 03:34:45 user nova-compute[74836]:   <name>instance-00000011</name>
Nov 14 03:34:45 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:34:45 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:34:45 user nova-compute[74836]:   <metadata>
Nov 14 03:34:45 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:45 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:name>tempest-tempest.common.compute-instance-2025290862</nova:name>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:34:45</nova:creationTime>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:34:45 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:45 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:owner>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:user uuid="f9aff38e58fe4a1b8bd4d46ceda55ba3">tempest-ServerActionsTestOtherA-585001335-project-member</nova:user>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:project uuid="06e7a009680c4c6d80ab5bb26d05b100">tempest-ServerActionsTestOtherA-585001335</nova:project>
Nov 14 03:34:45 user nova-compute[74836]:       </nova:owner>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:45 user nova-compute[74836]:       <nova:ports>
Nov 14 03:34:45 user nova-compute[74836]:         <nova:port uuid="b5f1b174-ff03-4f85-9de9-caf34175b732">
Nov 14 03:34:45 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:34:45 user nova-compute[74836]:         </nova:port>
Nov 14 03:34:45 user nova-compute[74836]:       </nova:ports>
Nov 14 03:34:45 user nova-compute[74836]:     </nova:instance>
Nov 14 03:34:45 user nova-compute[74836]:   </metadata>
Nov 14 03:34:45 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:34:45 user nova-compute[74836]:     <system>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="serial">c340e46d-8444-46be-a47f-13e9b91698a4</entry>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="uuid">c340e46d-8444-46be-a47f-13e9b91698a4</entry>
Nov 14 03:34:45 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:34:45 user nova-compute[74836]:     </system>
Nov 14 03:34:45 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:45 user nova-compute[74836]:   <os>
Nov 14 03:34:45 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:34:45 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:34:45 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:34:45 user nova-compute[74836]:   </os>
Nov 14 03:34:45 user nova-compute[74836]:   <features>
Nov 14 03:34:45 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:45 user nova-compute[74836]:     <apic/>
Nov 14 03:34:45 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:34:45 user nova-compute[74836]:   </features>
Nov 14 03:34:45 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:34:45 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:34:45 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:34:45 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:34:45 user nova-compute[74836]:   </clock>
Nov 14 03:34:45 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:34:45 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:34:45 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:34:45 user nova-compute[74836]:   </cpu>
Nov 14 03:34:45 user nova-compute[74836]:   <devices>
Nov 14 03:34:45 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:34:45 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:34:45 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk"/>
Nov 14 03:34:45 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:34:45 user nova-compute[74836]:     </disk>
Nov 14 03:34:45 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:34:45 user nova-compute[74836]:       <mac address="fa:16:3e:74:0e:44"/>
Nov 14 03:34:45 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:45 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:34:45 user nova-compute[74836]:       <target dev="tapb5f1b174-ff"/>
Nov 14 03:34:45 user nova-compute[74836]:     </interface>
Nov 14 03:34:45 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:34:45 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/console.log" append="off"/>
Nov 14 03:34:45 user nova-compute[74836]:     </serial>
Nov 14 03:34:45 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:34:45 user nova-compute[74836]:     <video>
Nov 14 03:34:45 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:45 user nova-compute[74836]:     </video>
Nov 14 03:34:45 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:34:45 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:34:45 user nova-compute[74836]:     </rng>
Nov 14 03:34:45 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:34:45 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:34:45 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:34:45 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:45 user nova-compute[74836]:   </devices>
Nov 14 03:34:45 user nova-compute[74836]: </domain>
Nov 14 03:34:45 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-tempest.common.compute-instance-2025290862',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG os_vif [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b75539b8-ddd3-52e5-87ab-306c1272ef0f', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f1b174-ff, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f1b174-ff, col_values=(('qos', UUID('93c723c2-2ff9-4234-9ba9-623643ed1fff')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f1b174-ff, col_values=(('external_ids', {'iface-id': 'b5f1b174-ff03-4f85-9de9-caf34175b732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:0e:44', 'vm-uuid': 'c340e46d-8444-46be-a47f-13e9b91698a4'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: INFO os_vif [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff')
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:74:0e:44, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.neutron [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updated VIF entry in instance network info cache for port b5f1b174-ff03-4f85-9de9-caf34175b732. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.network.neutron [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating instance_info_cache with network_info: [{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d16845df-506d-4fd7-adb2-eaca74a7a8d8 req-746e8cb4-ecdc-4039-aabf-ac4b97e031c5 service nova] Releasing lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updating instance_info_cache with network_info: [{"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-c6a98f6f-4e96-4b7f-864d-b6ae79521111" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:47 user nova-compute[74836]: WARNING nova.compute.manager [req-5cd0461f-7e37-41e2-86c2-97bea5ef42c5 req-922c6ce0-7ea1-4072-ba7d-7a0dd267de3e service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state building and task_state spawning.
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:47 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:34:48 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance spawned successfully.
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:49 user nova-compute[74836]: INFO nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Took 7.52 seconds to spawn the instance on the hypervisor.
Nov 14 03:34:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG nova.compute.manager [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG nova.compute.manager [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:34:49 user nova-compute[74836]: WARNING nova.compute.manager [req-1085bb27-484d-4f0a-b814-3639f4a3288c req-7f381bd9-82be-4f60-98c6-783694b60606 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state building and task_state spawning.
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:49 user nova-compute[74836]: INFO nova.compute.manager [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Took 8.34 seconds to build instance.
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-710bde3f-1570-4c0d-8156-9975f288545f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.450s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:34:50 user nova-compute[74836]: INFO nova.compute.claims [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Claim successful on node user
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.694s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:34:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:34:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Creating image(s)
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "/opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "/opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.policy [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '993f5484239e49b4b0c65f3c806a79c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d289f9188434ed4b52606eae4323bbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk 1073741824" returned: 0 in 0.064s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Cannot resize image /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Ensure instance console log exists: /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Successfully created port: 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:34:53 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:53 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7754MB free_disk=25.397232055664062GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Successfully updated port: 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquired lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 511e8759-a397-4300-9925-6fdf53a1631d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cc11bfda-4409-4b64-b4fe-be8acc05cf16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-changed-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Refreshing instance network info cache due to event network-changed-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] Acquiring lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:34:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating instance_info_cache with network_info: [{"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.624s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Releasing lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Instance network_info: |[{"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] Acquired lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Refreshing network info cache for port 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Start _get_guest_xml network_info=[{"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-295198805',display_name='tempest-SnapshotDataIntegrityTests-server-295198805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-295198805',id=18,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyNTakOMJfIgkGgt8CliYxtvFaMO85reKKHcbAkPYmPIKUdTbIGn1iItBUlAeUm9hZ5jLvH2XQElIR44nH1cDZ4BolEq7wYhRuBE894w54jSieivC7BAOax67LlTSOGbg==',key_name='tempest-keypair-568819793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d289f9188434ed4b52606eae4323bbc',ramdisk_id='',reservation_id='r-ri7ttlj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1739200041',owner_user_name='tempest-SnapshotDataIntegrityTests-1739200041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993f5484239e49b4b0c65f3c806a79c4',uuid=a6de739b-56d4-4d9c-99b5-0228b8ef5c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converting VIF {"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'pci_devices' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:34:54 user nova-compute[74836]:   <uuid>a6de739b-56d4-4d9c-99b5-0228b8ef5c82</uuid>
Nov 14 03:34:54 user nova-compute[74836]:   <name>instance-00000012</name>
Nov 14 03:34:54 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:34:54 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:34:54 user nova-compute[74836]:   <metadata>
Nov 14 03:34:54 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:34:54 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-295198805</nova:name>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:34:54</nova:creationTime>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:34:54 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:34:54 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:owner>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:user uuid="993f5484239e49b4b0c65f3c806a79c4">tempest-SnapshotDataIntegrityTests-1739200041-project-member</nova:user>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:project uuid="5d289f9188434ed4b52606eae4323bbc">tempest-SnapshotDataIntegrityTests-1739200041</nova:project>
Nov 14 03:34:54 user nova-compute[74836]:       </nova:owner>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:34:54 user nova-compute[74836]:       <nova:ports>
Nov 14 03:34:54 user nova-compute[74836]:         <nova:port uuid="6f2012ba-9faf-4b9e-a763-3f2fa9986a8a">
Nov 14 03:34:54 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 03:34:54 user nova-compute[74836]:         </nova:port>
Nov 14 03:34:54 user nova-compute[74836]:       </nova:ports>
Nov 14 03:34:54 user nova-compute[74836]:     </nova:instance>
Nov 14 03:34:54 user nova-compute[74836]:   </metadata>
Nov 14 03:34:54 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:34:54 user nova-compute[74836]:     <system>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="serial">a6de739b-56d4-4d9c-99b5-0228b8ef5c82</entry>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="uuid">a6de739b-56d4-4d9c-99b5-0228b8ef5c82</entry>
Nov 14 03:34:54 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:34:54 user nova-compute[74836]:     </system>
Nov 14 03:34:54 user nova-compute[74836]:   </sysinfo>
Nov 14 03:34:54 user nova-compute[74836]:   <os>
Nov 14 03:34:54 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:34:54 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:34:54 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:34:54 user nova-compute[74836]:   </os>
Nov 14 03:34:54 user nova-compute[74836]:   <features>
Nov 14 03:34:54 user nova-compute[74836]:     <acpi/>
Nov 14 03:34:54 user nova-compute[74836]:     <apic/>
Nov 14 03:34:54 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:34:54 user nova-compute[74836]:   </features>
Nov 14 03:34:54 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:34:54 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:34:54 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:34:54 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:34:54 user nova-compute[74836]:   </clock>
Nov 14 03:34:54 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:34:54 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:34:54 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:34:54 user nova-compute[74836]:   </cpu>
Nov 14 03:34:54 user nova-compute[74836]:   <devices>
Nov 14 03:34:54 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:34:54 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:34:54 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk"/>
Nov 14 03:34:54 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:34:54 user nova-compute[74836]:     </disk>
Nov 14 03:34:54 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:34:54 user nova-compute[74836]:       <mac address="fa:16:3e:90:40:c3"/>
Nov 14 03:34:54 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:54 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:34:54 user nova-compute[74836]:       <target dev="tap6f2012ba-9f"/>
Nov 14 03:34:54 user nova-compute[74836]:     </interface>
Nov 14 03:34:54 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:34:54 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/console.log" append="off"/>
Nov 14 03:34:54 user nova-compute[74836]:     </serial>
Nov 14 03:34:54 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:34:54 user nova-compute[74836]:     <video>
Nov 14 03:34:54 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:34:54 user nova-compute[74836]:     </video>
Nov 14 03:34:54 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:34:54 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:34:54 user nova-compute[74836]:     </rng>
Nov 14 03:34:54 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:34:54 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:34:54 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:34:54 user nova-compute[74836]:     </memballoon>
Nov 14 03:34:54 user nova-compute[74836]:   </devices>
Nov 14 03:34:54 user nova-compute[74836]: </domain>
Nov 14 03:34:54 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-295198805',display_name='tempest-SnapshotDataIntegrityTests-server-295198805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-295198805',id=18,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyNTakOMJfIgkGgt8CliYxtvFaMO85reKKHcbAkPYmPIKUdTbIGn1iItBUlAeUm9hZ5jLvH2XQElIR44nH1cDZ4BolEq7wYhRuBE894w54jSieivC7BAOax67LlTSOGbg==',key_name='tempest-keypair-568819793',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d289f9188434ed4b52606eae4323bbc',ramdisk_id='',reservation_id='r-ri7ttlj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1739200041',owner_user_name='tempest-SnapshotDataIntegrityTests-1739200041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993f5484239e49b4b0c65f3c806a79c4',uuid=a6de739b-56d4-4d9c-99b5-0228b8ef5c82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converting VIF {"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG os_vif [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5d18d3a-1dff-5b74-8198-1845eb8d818f', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f2012ba-9f, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f2012ba-9f, col_values=(('qos', UUID('1b6b54e4-7dd5-4e51-a0c4-a42b283c3e2e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f2012ba-9f, col_values=(('external_ids', {'iface-id': '6f2012ba-9faf-4b9e-a763-3f2fa9986a8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:40:c3', 'vm-uuid': 'a6de739b-56d4-4d9c-99b5-0228b8ef5c82'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:54 user nova-compute[74836]: INFO os_vif [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f')
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No VIF found with MAC fa:16:3e:90:40:c3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updated VIF entry in instance network info cache for port 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating instance_info_cache with network_info: [{"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:34:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-db431a56-549a-4240-914d-f759963299d9 req-e3de7e37-8930-40bc-8ade-21d4eaef6d75 service nova] Releasing lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:34:55 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:34:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:34:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Instance spawned successfully.
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:34:58 user nova-compute[74836]: INFO nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 14 03:34:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:34:58 user nova-compute[74836]: INFO nova.compute.manager [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Took 8.16 seconds to build instance.
Nov 14 03:34:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0621125e-3955-4612-803e-ec466afc26c3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.267s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:34:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:34:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:35:01 user nova-compute[74836]: INFO nova.compute.claims [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Claim successful on node user
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] No waiting events found dispatching network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:01 user nova-compute[74836]: WARNING nova.compute.manager [req-9a74fde2-e211-4feb-b4ab-f208ca8cc69e req-0e7b9ad9-57c2-4bd7-bae0-dc8f9872680d service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received unexpected event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a for instance with vm_state active and task_state None.
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.598s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:35:01 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:35:01 user nova-compute[74836]: INFO nova.virt.block_device [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Booting with volume 69a5eff9-c4dc-4950-a08f-7629d9c53916 at /dev/vda
Nov 14 03:35:01 user nova-compute[74836]: DEBUG nova.policy [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '54b79a4a562a4757bb2395d01893be63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7b5c31cc9284c3aafef858ac0db4678', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG os_brick.utils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab2c394-8652-4b68-990a-fb17e1d41d4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada0686f-c4a0-4d54-8c0d-9ac2ad7c2482]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311ae14-2c1c-4370-ba66-9960fc1291be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[338bbf71-3690-44a6-9aa6-511715be8289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:35:02 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:35:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e13cb0d-0ace-4c44-817f-064eff087295]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG os_brick.utils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating existing volume attachment record: 782fd2cb-39d5-4fdb-957e-8f8ea97e6949 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:02 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Successfully created port: ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Successfully updated port: ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquired lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-changed-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Refreshing instance network info cache due to event network-changed-ca953ed5-26d8-4999-b18c-e474e652351e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] Acquiring lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] No waiting events found dispatching network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:03 user nova-compute[74836]: WARNING nova.compute.manager [req-7eb9c49b-9e23-4651-bf72-84b75ccedb24 req-073a494e-83ed-479e-b77d-aa15e980de04 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received unexpected event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a for instance with vm_state active and task_state None.
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating instance_info_cache with network_info: [{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Releasing lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance network_info: |[{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] Acquired lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:03 user nova-compute[74836]: DEBUG nova.network.neutron [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Refreshing network info cache for port ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:35:04 user nova-compute[74836]: DEBUG nova.network.neutron [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updated VIF entry in instance network info cache for port ca953ed5-26d8-4999-b18c-e474e652351e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:35:04 user nova-compute[74836]: DEBUG nova.network.neutron [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating instance_info_cache with network_info: [{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6a1eedc3-d213-4043-bd7b-71705de4b4c2 req-4ec93710-b700-4144-9c81-71bb9b831634 service nova] Releasing lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:35:06 user nova-compute[74836]: INFO nova.compute.claims [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Claim successful on node user
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:35:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Creating image(s)
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Ensure instance console log exists: /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start _get_guest_xml network_info=[{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '063425f0-2fc0-4ece-818f-acfd647ee4fb', 'attached_at': '', 'detached_at': '', 'volume_id': '69a5eff9-c4dc-4950-a08f-7629d9c53916', 'serial': '69a5eff9-c4dc-4950-a08f-7629d9c53916'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '782fd2cb-39d5-4fdb-957e-8f8ea97e6949', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:35:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:35:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:35:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:35:06 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa9caf7-9f8f-4c4c-88db-9b7b2a189130]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:35:06 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a187de-35d9-4a99-84bc-5a215df82122]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916] added
Nov 14 03:35:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501aa4e-e9d2-4894-b43c-df5e42e16f30]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f072b292-3045-4db3-9c9c-007d07bc8dc0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWwmNUAj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWwmNUAj" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5af74d-4356-42d4-8118-33919842644a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWwmNUAj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5807d-fd39-44e8-873e-c98125eef8c7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[323cd6fe-da3a-43ed-a5a8-56c3cb0fb61c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ddbf5c-8721-40fc-a611-8152ff00c86d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]
Nov 14 03:35:07 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.
Nov 14 03:35:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.policy [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e3dfc3bf1754d7a8ab2ad232ae32715', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0284b6a8de1345d19d764a678e52b082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0feff3-66d7-45b4-9708-e26f14964ddd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:35:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Creating image(s)
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "/opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "/opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2804e7f-a5dc-4a61-8476-6989bbfce4fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:07 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:35:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe0cff-1c6f-4f7e-9282-c782c7b49828]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk 1073741824" returned: 0 in 0.063s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Successfully created port: b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Cannot resize image /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Ensure instance console log exists: /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23934643066316534', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934643066316534', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-625126260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lazy-loading 'pci_devices' on Instance uuid 063425f0-2fc0-4ece-818f-acfd647ee4fb {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:35:08 user nova-compute[74836]:   <uuid>063425f0-2fc0-4ece-818f-acfd647ee4fb</uuid>
Nov 14 03:35:08 user nova-compute[74836]:   <name>instance-00000013</name>
Nov 14 03:35:08 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:35:08 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:35:08 user nova-compute[74836]:   <metadata>
Nov 14 03:35:08 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:35:08 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:name>tempest-ServerActionsV293TestJSON-server-625126260</nova:name>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:35:06</nova:creationTime>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:35:08 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:owner>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:user uuid="54b79a4a562a4757bb2395d01893be63">tempest-ServerActionsV293TestJSON-380744936-project-member</nova:user>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:project uuid="b7b5c31cc9284c3aafef858ac0db4678">tempest-ServerActionsV293TestJSON-380744936</nova:project>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:owner>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:ports>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:port uuid="ca953ed5-26d8-4999-b18c-e474e652351e">
Nov 14 03:35:08 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:35:08 user nova-compute[74836]:         </nova:port>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:ports>
Nov 14 03:35:08 user nova-compute[74836]:     </nova:instance>
Nov 14 03:35:08 user nova-compute[74836]:   </metadata>
Nov 14 03:35:08 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:35:08 user nova-compute[74836]:     <system>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="serial">063425f0-2fc0-4ece-818f-acfd647ee4fb</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="uuid">063425f0-2fc0-4ece-818f-acfd647ee4fb</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:35:08 user nova-compute[74836]:     </system>
Nov 14 03:35:08 user nova-compute[74836]:   </sysinfo>
Nov 14 03:35:08 user nova-compute[74836]:   <os>
Nov 14 03:35:08 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:35:08 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:35:08 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:35:08 user nova-compute[74836]:   </os>
Nov 14 03:35:08 user nova-compute[74836]:   <features>
Nov 14 03:35:08 user nova-compute[74836]:     <acpi/>
Nov 14 03:35:08 user nova-compute[74836]:     <apic/>
Nov 14 03:35:08 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:35:08 user nova-compute[74836]:   </features>
Nov 14 03:35:08 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:35:08 user nova-compute[74836]:   </clock>
Nov 14 03:35:08 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:35:08 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:35:08 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:35:08 user nova-compute[74836]:   </cpu>
Nov 14 03:35:08 user nova-compute[74836]:   <devices>
Nov 14 03:35:08 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:35:08 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:35:08 user nova-compute[74836]:       <source dev="/dev/sdd"/>
Nov 14 03:35:08 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:       <serial>69a5eff9-c4dc-4950-a08f-7629d9c53916</serial>
Nov 14 03:35:08 user nova-compute[74836]:     </disk>
Nov 14 03:35:08 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:35:08 user nova-compute[74836]:       <mac address="fa:16:3e:6a:c5:e2"/>
Nov 14 03:35:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:35:08 user nova-compute[74836]:       <target dev="tapca953ed5-26"/>
Nov 14 03:35:08 user nova-compute[74836]:     </interface>
Nov 14 03:35:08 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:35:08 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb/console.log" append="off"/>
Nov 14 03:35:08 user nova-compute[74836]:     </serial>
Nov 14 03:35:08 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:35:08 user nova-compute[74836]:     <video>
Nov 14 03:35:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:     </video>
Nov 14 03:35:08 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:35:08 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:35:08 user nova-compute[74836]:     </rng>
Nov 14 03:35:08 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:35:08 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:35:08 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:35:08 user nova-compute[74836]:     </memballoon>
Nov 14 03:35:08 user nova-compute[74836]:   </devices>
Nov 14 03:35:08 user nova-compute[74836]: </domain>
Nov 14 03:35:08 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-625126260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG os_vif [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0422878c-f6df-5a1c-8909-4b396b1ba986', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca953ed5-26, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca953ed5-26, col_values=(('qos', UUID('db33a21b-867d-4454-8b0c-89dd0f2fb527')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca953ed5-26, col_values=(('external_ids', {'iface-id': 'ca953ed5-26d8-4999-b18c-e474e652351e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c5:e2', 'vm-uuid': '063425f0-2fc0-4ece-818f-acfd647ee4fb'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: INFO os_vif [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26')
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] No VIF found with MAC fa:16:3e:6a:c5:e2, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Successfully updated port: b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquired lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-changed-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Refreshing instance network info cache due to event network-changed-b0639cac-1a93-42db-813d-35dd094ab18e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] Acquiring lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating instance_info_cache with network_info: [{"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Releasing lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Instance network_info: |[{"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] Acquired lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Refreshing network info cache for port b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Start _get_guest_xml network_info=[{"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:35:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1078065673',display_name='tempest-TestServerVolumeAttachmentScenario-server-1078065673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1078065673',id=20,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/AZi1SnXIY2JCl3grz5RG65CPWo3XXJilgY/lhXLzlrE+StTKgSl/BSF5VJbNgU32IS9iHCQYwUTse3aA1EaOwQAmo1gUIkB9qxLRI8o8d+TR8sTcGagvqkEMW4iesOQ==',key_name='tempest-keypair-1197670460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0284b6a8de1345d19d764a678e52b082',ramdisk_id='',reservation_id='r-nnoyv41x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-162628675',owner_user_name='tempest-TestServerVolumeAttachmentScenario-162628675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3dfc3bf1754d7a8ab2ad232ae32715',uuid=6ee0263f-76cc-41e6-bb00-ed8c61d586cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converting VIF {"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:35:08 user nova-compute[74836]:   <uuid>6ee0263f-76cc-41e6-bb00-ed8c61d586cc</uuid>
Nov 14 03:35:08 user nova-compute[74836]:   <name>instance-00000014</name>
Nov 14 03:35:08 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:35:08 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:35:08 user nova-compute[74836]:   <metadata>
Nov 14 03:35:08 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:35:08 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1078065673</nova:name>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:35:08</nova:creationTime>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:35:08 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:owner>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:user uuid="5e3dfc3bf1754d7a8ab2ad232ae32715">tempest-TestServerVolumeAttachmentScenario-162628675-project-member</nova:user>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:project uuid="0284b6a8de1345d19d764a678e52b082">tempest-TestServerVolumeAttachmentScenario-162628675</nova:project>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:owner>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:35:08 user nova-compute[74836]:       <nova:ports>
Nov 14 03:35:08 user nova-compute[74836]:         <nova:port uuid="b0639cac-1a93-42db-813d-35dd094ab18e">
Nov 14 03:35:08 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 03:35:08 user nova-compute[74836]:         </nova:port>
Nov 14 03:35:08 user nova-compute[74836]:       </nova:ports>
Nov 14 03:35:08 user nova-compute[74836]:     </nova:instance>
Nov 14 03:35:08 user nova-compute[74836]:   </metadata>
Nov 14 03:35:08 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:35:08 user nova-compute[74836]:     <system>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="serial">6ee0263f-76cc-41e6-bb00-ed8c61d586cc</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="uuid">6ee0263f-76cc-41e6-bb00-ed8c61d586cc</entry>
Nov 14 03:35:08 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:35:08 user nova-compute[74836]:     </system>
Nov 14 03:35:08 user nova-compute[74836]:   </sysinfo>
Nov 14 03:35:08 user nova-compute[74836]:   <os>
Nov 14 03:35:08 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:35:08 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:35:08 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:35:08 user nova-compute[74836]:   </os>
Nov 14 03:35:08 user nova-compute[74836]:   <features>
Nov 14 03:35:08 user nova-compute[74836]:     <acpi/>
Nov 14 03:35:08 user nova-compute[74836]:     <apic/>
Nov 14 03:35:08 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:35:08 user nova-compute[74836]:   </features>
Nov 14 03:35:08 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:35:08 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:35:08 user nova-compute[74836]:   </clock>
Nov 14 03:35:08 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:35:08 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:35:08 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:35:08 user nova-compute[74836]:   </cpu>
Nov 14 03:35:08 user nova-compute[74836]:   <devices>
Nov 14 03:35:08 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:35:08 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:35:08 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk"/>
Nov 14 03:35:08 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:     </disk>
Nov 14 03:35:08 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:35:08 user nova-compute[74836]:       <mac address="fa:16:3e:9c:fc:93"/>
Nov 14 03:35:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:35:08 user nova-compute[74836]:       <target dev="tapb0639cac-1a"/>
Nov 14 03:35:08 user nova-compute[74836]:     </interface>
Nov 14 03:35:08 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:35:08 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/console.log" append="off"/>
Nov 14 03:35:08 user nova-compute[74836]:     </serial>
Nov 14 03:35:08 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:35:08 user nova-compute[74836]:     <video>
Nov 14 03:35:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:08 user nova-compute[74836]:     </video>
Nov 14 03:35:08 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:35:08 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:35:08 user nova-compute[74836]:     </rng>
Nov 14 03:35:08 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:35:08 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:35:08 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:35:08 user nova-compute[74836]:     </memballoon>
Nov 14 03:35:08 user nova-compute[74836]:   </devices>
Nov 14 03:35:08 user nova-compute[74836]: </domain>
Nov 14 03:35:08 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1078065673',display_name='tempest-TestServerVolumeAttachmentScenario-server-1078065673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1078065673',id=20,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/AZi1SnXIY2JCl3grz5RG65CPWo3XXJilgY/lhXLzlrE+StTKgSl/BSF5VJbNgU32IS9iHCQYwUTse3aA1EaOwQAmo1gUIkB9qxLRI8o8d+TR8sTcGagvqkEMW4iesOQ==',key_name='tempest-keypair-1197670460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0284b6a8de1345d19d764a678e52b082',ramdisk_id='',reservation_id='r-nnoyv41x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-162628675',owner_user_name='tempest-TestServerVolumeAttachmentScenario-162628675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3dfc3bf1754d7a8ab2ad232ae32715',uuid=6ee0263f-76cc-41e6-bb00-ed8c61d586cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converting VIF {"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG os_vif [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b02d9fc0-32d7-5239-b4a6-82827ca770e2', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0639cac-1a, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0639cac-1a, col_values=(('qos', UUID('0077ad7e-b842-417e-b6c7-c6c3bd5f0b6d')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0639cac-1a, col_values=(('external_ids', {'iface-id': 'b0639cac-1a93-42db-813d-35dd094ab18e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:fc:93', 'vm-uuid': '6ee0263f-76cc-41e6-bb00-ed8c61d586cc'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:09 user nova-compute[74836]: INFO os_vif [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a')
Nov 14 03:35:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No VIF found with MAC fa:16:3e:9c:fc:93, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updated VIF entry in instance network info cache for port b0639cac-1a93-42db-813d-35dd094ab18e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating instance_info_cache with network_info: [{"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c5646eb-a447-49cd-8293-59d230bc108e req-0f6d1fa6-5917-4ff8-a1b5-68a96e3ecf05 service nova] Releasing lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:10 user nova-compute[74836]: WARNING nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state building and task_state spawning.
Nov 14 03:35:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:10 user nova-compute[74836]: WARNING nova.compute.manager [req-c0a897e4-b1cb-4dbb-bc82-09c699a35883 req-acc7efa7-b0d5-49ca-98bf-ba57dceec106 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state building and task_state spawning.
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] No waiting events found dispatching network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:11 user nova-compute[74836]: WARNING nova.compute.manager [req-fd97ad1d-222d-49cd-9796-153008a5b3d6 req-e8630c10-d7aa-4607-87c7-a56fc898abc9 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received unexpected event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e for instance with vm_state building and task_state spawning.
Nov 14 03:35:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance spawned successfully.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Instance spawned successfully.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] No waiting events found dispatching network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:13 user nova-compute[74836]: WARNING nova.compute.manager [req-20743fc9-7b66-4368-989e-2851575d90dc req-71a8e176-3499-44dd-a7e4-d0d75e2a9397 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received unexpected event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e for instance with vm_state building and task_state spawning.
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.compute.manager [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Took 12.92 seconds to build instance.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7333cd4e-9d0c-47ff-9353-19732ef858ce tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.054s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:13 user nova-compute[74836]: INFO nova.compute.manager [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Took 7.69 seconds to build instance.
Nov 14 03:35:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d08fafc7-ecc7-413e-b7b7-7185455539f9 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.790s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:29 user nova-compute[74836]: INFO nova.compute.manager [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Rescuing
Nov 14 03:35:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:29 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:35:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:30 user nova-compute[74836]: WARNING nova.compute.manager [req-4421b725-ec06-4668-be27-421144c48f54 req-a7a49943-4211-4e24-98c0-606d0fea8590 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance destroyed successfully.
Nov 14 03:35:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Attempting rescue
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:35:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Creating image(s)
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue" returned: 0 in 0.050s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'migration_context' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.base [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<07ea4caa-d030-4ca6-b716-49d37a2d7a0d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start _get_guest_xml network_info=[{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:01:ce:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.base [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<07ea4caa-d030-4ca6-b716-49d37a2d7a0d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'numa_topology' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.base [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<07ea4caa-d030-4ca6-b716-49d37a2d7a0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.base [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<07ea4caa-d030-4ca6-b716-49d37a2d7a0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-281568390',display_name='tempest-ServerRescueNegativeTestJSON-server-281568390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-281568390',id=1,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:30:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-6ln573ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:31:00Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=07ea4caa-d030-4ca6-b716-49d37a2d7a0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:01:ce:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:01:ce:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.objects.base [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<07ea4caa-d030-4ca6-b716-49d37a2d7a0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:35:31 user nova-compute[74836]:   <uuid>07ea4caa-d030-4ca6-b716-49d37a2d7a0d</uuid>
Nov 14 03:35:31 user nova-compute[74836]:   <name>instance-00000001</name>
Nov 14 03:35:31 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:35:31 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:35:31 user nova-compute[74836]:   <metadata>
Nov 14 03:35:31 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:35:31 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-281568390</nova:name>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:35:31</nova:creationTime>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:35:31 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:35:31 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:owner>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:35:31 user nova-compute[74836]:       </nova:owner>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:35:31 user nova-compute[74836]:       <nova:ports>
Nov 14 03:35:31 user nova-compute[74836]:         <nova:port uuid="86d1e467-9870-48ab-9291-033f4f673003">
Nov 14 03:35:31 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:35:31 user nova-compute[74836]:         </nova:port>
Nov 14 03:35:31 user nova-compute[74836]:       </nova:ports>
Nov 14 03:35:31 user nova-compute[74836]:     </nova:instance>
Nov 14 03:35:31 user nova-compute[74836]:   </metadata>
Nov 14 03:35:31 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:35:31 user nova-compute[74836]:     <system>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="serial">07ea4caa-d030-4ca6-b716-49d37a2d7a0d</entry>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="uuid">07ea4caa-d030-4ca6-b716-49d37a2d7a0d</entry>
Nov 14 03:35:31 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:35:31 user nova-compute[74836]:     </system>
Nov 14 03:35:31 user nova-compute[74836]:   </sysinfo>
Nov 14 03:35:31 user nova-compute[74836]:   <os>
Nov 14 03:35:31 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:35:31 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:35:31 user nova-compute[74836]:   </os>
Nov 14 03:35:31 user nova-compute[74836]:   <features>
Nov 14 03:35:31 user nova-compute[74836]:     <acpi/>
Nov 14 03:35:31 user nova-compute[74836]:     <apic/>
Nov 14 03:35:31 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:35:31 user nova-compute[74836]:   </features>
Nov 14 03:35:31 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:35:31 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:35:31 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:35:31 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:35:31 user nova-compute[74836]:   </clock>
Nov 14 03:35:31 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:35:31 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:35:31 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:35:31 user nova-compute[74836]:   </cpu>
Nov 14 03:35:31 user nova-compute[74836]:   <devices>
Nov 14 03:35:31 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:35:31 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:35:31 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue"/>
Nov 14 03:35:31 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:35:31 user nova-compute[74836]:     </disk>
Nov 14 03:35:31 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:35:31 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:35:31 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk"/>
Nov 14 03:35:31 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:35:31 user nova-compute[74836]:     </disk>
Nov 14 03:35:31 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:35:31 user nova-compute[74836]:       <mac address="fa:16:3e:01:ce:e3"/>
Nov 14 03:35:31 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:31 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:35:31 user nova-compute[74836]:       <target dev="tap86d1e467-98"/>
Nov 14 03:35:31 user nova-compute[74836]:     </interface>
Nov 14 03:35:31 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:35:31 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/console.log" append="off"/>
Nov 14 03:35:31 user nova-compute[74836]:     </serial>
Nov 14 03:35:31 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:35:31 user nova-compute[74836]:     <video>
Nov 14 03:35:31 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:31 user nova-compute[74836]:     </video>
Nov 14 03:35:31 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:35:31 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:35:31 user nova-compute[74836]:     </rng>
Nov 14 03:35:31 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:35:31 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:35:31 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:35:31 user nova-compute[74836]:     </memballoon>
Nov 14 03:35:31 user nova-compute[74836]:   </devices>
Nov 14 03:35:31 user nova-compute[74836]: </domain>
Nov 14 03:35:31 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:35:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance destroyed successfully.
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:01:ce:e3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:35:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:32 user nova-compute[74836]: WARNING nova.compute.manager [req-9a8b1299-1b2d-42a0-8443-fd17d3b78e72 req-0683fd9f-7fb7-44b9-9244-4fbb2826b01a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:35:34 user nova-compute[74836]: INFO nova.compute.claims [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Claim successful on node user
Nov 14 03:35:34 user nova-compute[74836]: INFO nova.compute.manager [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Rescuing
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:34 user nova-compute[74836]: WARNING nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:34 user nova-compute[74836]: WARNING nova.compute.manager [req-f65b34ed-ff91-4a64-a8c2-468594ccf7d6 req-ce8f6cdb-ae20-4400-9708-8f77e1cf787d service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.688s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:35:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.policy [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78158b7b223e442bb4c5e79b60f71f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9958a22099df444781166f5b1925bdf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:35:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Creating image(s)
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "003a5010c3b21ba2f20c27573970241c310b21da" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "003a5010c3b21ba2f20c27573970241c310b21da" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ce6cd7d4-682b-4bf6-bb64-231ed6b624a3 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.part --force-share --output=json" returned: 0 in 0.233s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.virt.images [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] 56e372cc-ad8c-4a33-a9b0-2beac0ffd89b was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:35:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.part /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.part /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.converted" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Successfully created port: b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "003a5010c3b21ba2f20c27573970241c310b21da" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.140s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "003a5010c3b21ba2f20c27573970241c310b21da" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "003a5010c3b21ba2f20c27573970241c310b21da" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:36 user nova-compute[74836]: WARNING nova.compute.manager [req-442cf931-05a0-464a-8f96-b841ba6fce66 req-0af7e3a3-383b-4983-acf7-b060fc1a8608 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json" returned: 0 in 0.215s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da,backing_fmt=raw /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da,backing_fmt=raw /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk 1073741824" returned: 0 in 0.068s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "003a5010c3b21ba2f20c27573970241c310b21da" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance destroyed successfully.
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da --force-share --output=json" returned: 0 in 0.212s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Attempting a stable device rescue
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:35:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Creating image(s)
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'trusted_certs' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "04c184d03f457c2a70daabc12a124ca6470e857f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "04c184d03f457c2a70daabc12a124ca6470e857f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Cannot resize image /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Ensure instance console log exists: /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Successfully updated port: b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquired lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.part --force-share --output=json" returned: 0 in 0.230s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.images [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] 5dcf3006-430a-497d-819b-eae0f2279ce4 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.part /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.part /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.converted" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating instance_info_cache with network_info: [{"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Releasing lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Instance network_info: |[{"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Start _get_guest_xml network_info=[{"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:35:29Z,direct_url=<?>,disk_format='qcow2',id=56e372cc-ad8c-4a33-a9b0-2beac0ffd89b,min_disk=0,min_ram=0,name='',owner='0b39aa21cf3b4e0fae6988c954cdad84',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:35:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'disk_bus': 'scsi', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '56e372cc-ad8c-4a33-a9b0-2beac0ffd89b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:35:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:35:29Z,direct_url=<?>,disk_format='qcow2',id=56e372cc-ad8c-4a33-a9b0-2beac0ffd89b,min_disk=0,min_ram=0,name='',owner='0b39aa21cf3b4e0fae6988c954cdad84',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:35:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1605792734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1605792734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1605792734',id=21,image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtwCzTuvtDDXMO9o7tGnUylAaiIJSM3AYB2Cw7v3YZCXW3me9dURyZmwU9ubIyZqQkEY9DJw2Yhd43NNemoxwNjsJG3DVCAEpK/+rD0XxNMlQqb6EvIrchlYALr+bCJg==',key_name='tempest-keypair-1273506546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9958a22099df444781166f5b1925bdf0',ramdisk_id='',reservation_id='r-nry4hupl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1574746081',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1574746081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78158b7b223e442bb4c5e79b60f71f51',uuid=5a73b38d-15ff-4132-9fbd-cf82055ca67a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converting VIF {"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:35:38 user nova-compute[74836]:   <uuid>5a73b38d-15ff-4132-9fbd-cf82055ca67a</uuid>
Nov 14 03:35:38 user nova-compute[74836]:   <name>instance-00000015</name>
Nov 14 03:35:38 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:35:38 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:35:38 user nova-compute[74836]:   <metadata>
Nov 14 03:35:38 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:35:38 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1605792734</nova:name>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:35:38</nova:creationTime>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:35:38 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:35:38 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:owner>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:user uuid="78158b7b223e442bb4c5e79b60f71f51">tempest-AttachSCSIVolumeTestJSON-1574746081-project-member</nova:user>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:project uuid="9958a22099df444781166f5b1925bdf0">tempest-AttachSCSIVolumeTestJSON-1574746081</nova:project>
Nov 14 03:35:38 user nova-compute[74836]:       </nova:owner>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:root type="image" uuid="56e372cc-ad8c-4a33-a9b0-2beac0ffd89b"/>
Nov 14 03:35:38 user nova-compute[74836]:       <nova:ports>
Nov 14 03:35:38 user nova-compute[74836]:         <nova:port uuid="b8cba6e3-3e2c-484c-bb67-732b376f3025">
Nov 14 03:35:38 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 03:35:38 user nova-compute[74836]:         </nova:port>
Nov 14 03:35:38 user nova-compute[74836]:       </nova:ports>
Nov 14 03:35:38 user nova-compute[74836]:     </nova:instance>
Nov 14 03:35:38 user nova-compute[74836]:   </metadata>
Nov 14 03:35:38 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:35:38 user nova-compute[74836]:     <system>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="serial">5a73b38d-15ff-4132-9fbd-cf82055ca67a</entry>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="uuid">5a73b38d-15ff-4132-9fbd-cf82055ca67a</entry>
Nov 14 03:35:38 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:35:38 user nova-compute[74836]:     </system>
Nov 14 03:35:38 user nova-compute[74836]:   </sysinfo>
Nov 14 03:35:38 user nova-compute[74836]:   <os>
Nov 14 03:35:38 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:35:38 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:35:38 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:35:38 user nova-compute[74836]:   </os>
Nov 14 03:35:38 user nova-compute[74836]:   <features>
Nov 14 03:35:38 user nova-compute[74836]:     <acpi/>
Nov 14 03:35:38 user nova-compute[74836]:     <apic/>
Nov 14 03:35:38 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:35:38 user nova-compute[74836]:   </features>
Nov 14 03:35:38 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:35:38 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:35:38 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:35:38 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:35:38 user nova-compute[74836]:   </clock>
Nov 14 03:35:38 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:35:38 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:35:38 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:35:38 user nova-compute[74836]:   </cpu>
Nov 14 03:35:38 user nova-compute[74836]:   <devices>
Nov 14 03:35:38 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:35:38 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:35:38 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk"/>
Nov 14 03:35:38 user nova-compute[74836]:       <target dev="sda" bus="scsi"/>
Nov 14 03:35:38 user nova-compute[74836]:       <address type="drive" controller="0" unit="0"/>
Nov 14 03:35:38 user nova-compute[74836]:     </disk>
Nov 14 03:35:38 user nova-compute[74836]:     <disk type="file" device="cdrom">
Nov 14 03:35:38 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 03:35:38 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.config"/>
Nov 14 03:35:38 user nova-compute[74836]:       <target dev="sdb" bus="scsi"/>
Nov 14 03:35:38 user nova-compute[74836]:       <address type="drive" controller="0" unit="1"/>
Nov 14 03:35:38 user nova-compute[74836]:     </disk>
Nov 14 03:35:38 user nova-compute[74836]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 03:35:38 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:35:38 user nova-compute[74836]:       <mac address="fa:16:3e:b7:36:28"/>
Nov 14 03:35:38 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:38 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:35:38 user nova-compute[74836]:       <target dev="tapb8cba6e3-3e"/>
Nov 14 03:35:38 user nova-compute[74836]:     </interface>
Nov 14 03:35:38 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:35:38 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/console.log" append="off"/>
Nov 14 03:35:38 user nova-compute[74836]:     </serial>
Nov 14 03:35:38 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:35:38 user nova-compute[74836]:     <video>
Nov 14 03:35:38 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:38 user nova-compute[74836]:     </video>
Nov 14 03:35:38 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:35:38 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:35:38 user nova-compute[74836]:     </rng>
Nov 14 03:35:38 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:35:38 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:35:38 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:35:38 user nova-compute[74836]:     </memballoon>
Nov 14 03:35:38 user nova-compute[74836]:   </devices>
Nov 14 03:35:38 user nova-compute[74836]: </domain>
Nov 14 03:35:38 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1605792734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1605792734',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1605792734',id=21,image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtwCzTuvtDDXMO9o7tGnUylAaiIJSM3AYB2Cw7v3YZCXW3me9dURyZmwU9ubIyZqQkEY9DJw2Yhd43NNemoxwNjsJG3DVCAEpK/+rD0XxNMlQqb6EvIrchlYALr+bCJg==',key_name='tempest-keypair-1273506546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9958a22099df444781166f5b1925bdf0',ramdisk_id='',reservation_id='r-nry4hupl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1574746081',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1574746081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:35:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78158b7b223e442bb4c5e79b60f71f51',uuid=5a73b38d-15ff-4132-9fbd-cf82055ca67a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converting VIF {"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG os_vif [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aad0ccfb-1ffd-5d73-a951-0f65c063dac4', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "04c184d03f457c2a70daabc12a124ca6470e857f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.624s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "04c184d03f457c2a70daabc12a124ca6470e857f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "04c184d03f457c2a70daabc12a124ca6470e857f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8cba6e3-3e, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8cba6e3-3e, col_values=(('qos', UUID('8a999517-66aa-438e-865f-fa1de71dc192')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8cba6e3-3e, col_values=(('external_ids', {'iface-id': 'b8cba6e3-3e2c-484c-bb67-732b376f3025', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:36:28', 'vm-uuid': '5a73b38d-15ff-4132-9fbd-cf82055ca67a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:38 user nova-compute[74836]: INFO os_vif [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e')
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:38 user nova-compute[74836]: WARNING nova.compute.manager [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-changed-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Refreshing instance network info cache due to event network-changed-b8cba6e3-3e2c-484c-bb67-732b376f3025. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Acquiring lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Acquired lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:38 user nova-compute[74836]: DEBUG nova.network.neutron [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Refreshing network info cache for port b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f --force-share --output=json" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f,backing_fmt=raw /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No BDM found with device name sda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No VIF found with MAC fa:16:3e:b7:36:28, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:35:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Using config drive
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f,backing_fmt=raw /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue" returned: 0 in 0.072s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "04c184d03f457c2a70daabc12a124ca6470e857f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'migration_context' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start _get_guest_xml network_info=[{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:54:0b:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5dcf3006-430a-497d-819b-eae0f2279ce4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'serial': 'f3bdddb8-7fcc-48b4-9cab-0e0c66a34749'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8eb41d7a-0b69-4d9e-aaff-5af33ce025b9', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'numa_topology' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'vcpu_model' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:35:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:35:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:35:39 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8930a839-f6cb-46dc-bf8f-2f34578d83af]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xOJKfspj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 03:35:39 user nova-compute[74836]: node.name = iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:35:39 user nova-compute[74836]: node.tpgt = -1
Nov 14 03:35:39 user nova-compute[74836]: node.startup = automatic
Nov 14 03:35:39 user nova-compute[74836]: node.leading_login = No
Nov 14 03:35:39 user nova-compute[74836]: iface.iscsi_ifacename = default
Nov 14 03:35:39 user nova-compute[74836]: iface.net_ifacename = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.ipaddress = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.prefix_len = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.hwaddress = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.transport_name = tcp
Nov 14 03:35:39 user nova-compute[74836]: iface.initiatorname = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.vlan_id = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.vlan_priority = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.vlan_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.iface_num = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.mtu = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.port = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.bootproto = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.subnet_mask = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.gateway = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_alt_client_id = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_dns = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_learn_iqn = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_vendor_id_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_vendor_id = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.dhcp_slp_da = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.fragmentation = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.gratuitous_arp = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.incoming_forwarding = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.tos_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.tos = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.ttl = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.delayed_ack = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.tcp_nagle = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.tcp_wsf_state = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.tcp_wsf = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.tcp_timer_scale = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.tcp_timestamp = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.redirect = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.def_task_mgmt_timeout = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.header_digest = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.data_digest = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.immediate_data = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.initial_r2t = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.data_seq_inorder = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.data_pdu_inorder = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.erl = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.max_receive_data_len = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.first_burst_len = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.max_outstanding_r2t = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.max_burst_len = 0
Nov 14 03:35:39 user nova-compute[74836]: iface.chap_auth = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.bidi_chap = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.strict_login_compliance = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.discovery_auth = <empty>
Nov 14 03:35:39 user nova-compute[74836]: iface.discovery_logout = <empty>
Nov 14 03:35:39 user nova-compute[74836]: node.discovery_address = <empty>
Nov 14 03:35:39 user nova-compute[74836]: node.discovery_port = 0
Nov 14 03:35:39 user nova-compute[74836]: node.discovery_type = static
Nov 14 03:35:39 user nova-compute[74836]: node.session.initial_cmdsn = 0
Nov 14 03:35:39 user nova-compute[74836]: node.session.initial_login_retry_max = 8
Nov 14 03:35:39 user nova-compute[74836]: node.session.xmit_thread_priority = -20
Nov 14 03:35:39 user nova-compute[74836]: node.session.cmds_max = 128
Nov 14 03:35:39 user nova-compute[74836]: node.session.queue_depth = 32
Nov 14 03:35:39 user nova-compute[74836]: node.session.nr_sessions = 1
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.authmethod = CHAP
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.username = xOJKfspj
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.password = ***
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.username_in = <empty>
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.password_in = <empty>
Nov 14 03:35:39 user nova-compute[74836]: node.session.auth.chap_algs = MD5
Nov 14 03:35:39 user nova-compute[74836]: node.session.timeo.replacement_timeout = 120
Nov 14 03:35:39 user nova-compute[74836]: node.session.err_timeo.abort_timeout = 15
Nov 14 03:35:39 user nova-compute[74836]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 03:35:39 user nova-compute[74836]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 03:35:39 user nova-compute[74836]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.FastAbort = Yes
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.InitialR2T = No
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.ImmediateData = Yes
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.MaxConnections = 1
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 03:35:39 user nova-compute[74836]: node.session.iscsi.ERL = 0
Nov 14 03:35:39 user nova-compute[74836]: node.session.scan = manual
Nov 14 03:35:39 user nova-compute[74836]: node.session.reopen_max = 0
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].address = 172.16.0.220
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].port = 3260
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].startup = manual
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].tcp.window_size = 524288
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].tcp.type_of_service = 0
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].timeo.logout_timeout = 15
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].timeo.login_timeout = 15
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].timeo.auth_timeout = 45
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.DataDigest = None
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.IFMarker = No
Nov 14 03:35:39 user nova-compute[74836]: node.conn[0].iscsi.OFMarker = No
Nov 14 03:35:39 user nova-compute[74836]: # END RECORD
Nov 14 03:35:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02ba44-d399-453d-ba15-2b89a262240f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Creating config drive at /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.config
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph87ohs75 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a52fe-13e5-4ddd-8b5b-5d46bb3e87e9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOJKfspj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph87ohs75" returned: 0 in 0.071s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOJKfspj" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee011c7-767d-42ef-bcab-2eeaba208c9c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xOJKfspj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[994db06e-cdd0-4135-b19b-e26742bbec42]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e54053-834b-44e6-979c-d6f31e8eddff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:39 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:35:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:35:39 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:35:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:35:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c3126-9643-472b-85be-b80bdf76282f]: (4, ('0 0 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.282s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== connect_volume: return (283ms) {'type': 'block', 'scsi_wwn': '26564663435376636', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564663435376636', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1784073350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1784073350',id=15,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:33:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-vlp9ukwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:34:00Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:54:0b:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:54:0b:4f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.network.neutron [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updated VIF entry in instance network info cache for port b8cba6e3-3e2c-484c-bb67-732b376f3025. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.network.neutron [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating instance_info_cache with network_info: [{"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:35:39 user nova-compute[74836]:   <uuid>cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</uuid>
Nov 14 03:35:39 user nova-compute[74836]:   <name>instance-0000000f</name>
Nov 14 03:35:39 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:35:39 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:35:39 user nova-compute[74836]:   <metadata>
Nov 14 03:35:39 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:35:39 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1784073350</nova:name>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:35:39</nova:creationTime>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:35:39 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:35:39 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:owner>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:35:39 user nova-compute[74836]:       </nova:owner>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:35:39 user nova-compute[74836]:       <nova:ports>
Nov 14 03:35:39 user nova-compute[74836]:         <nova:port uuid="778fc191-dbfd-4ee5-8a9f-4ca3c4679804">
Nov 14 03:35:39 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:35:39 user nova-compute[74836]:         </nova:port>
Nov 14 03:35:39 user nova-compute[74836]:       </nova:ports>
Nov 14 03:35:39 user nova-compute[74836]:     </nova:instance>
Nov 14 03:35:39 user nova-compute[74836]:   </metadata>
Nov 14 03:35:39 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:35:39 user nova-compute[74836]:     <system>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="serial">cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</entry>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="uuid">cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d</entry>
Nov 14 03:35:39 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:35:39 user nova-compute[74836]:     </system>
Nov 14 03:35:39 user nova-compute[74836]:   </sysinfo>
Nov 14 03:35:39 user nova-compute[74836]:   <os>
Nov 14 03:35:39 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:35:39 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:35:39 user nova-compute[74836]:   </os>
Nov 14 03:35:39 user nova-compute[74836]:   <features>
Nov 14 03:35:39 user nova-compute[74836]:     <acpi/>
Nov 14 03:35:39 user nova-compute[74836]:     <apic/>
Nov 14 03:35:39 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:35:39 user nova-compute[74836]:   </features>
Nov 14 03:35:39 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:35:39 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:35:39 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:35:39 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:35:39 user nova-compute[74836]:   </clock>
Nov 14 03:35:39 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:35:39 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:35:39 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:35:39 user nova-compute[74836]:   </cpu>
Nov 14 03:35:39 user nova-compute[74836]:   <devices>
Nov 14 03:35:39 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:35:39 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:35:39 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 03:35:39 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:35:39 user nova-compute[74836]:       <serial>f3bdddb8-7fcc-48b4-9cab-0e0c66a34749</serial>
Nov 14 03:35:39 user nova-compute[74836]:     </disk>
Nov 14 03:35:39 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:35:39 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:35:39 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue"/>
Nov 14 03:35:39 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:35:39 user nova-compute[74836]:       <boot order="1"/>
Nov 14 03:35:39 user nova-compute[74836]:     </disk>
Nov 14 03:35:39 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:35:39 user nova-compute[74836]:       <mac address="fa:16:3e:54:0b:4f"/>
Nov 14 03:35:39 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:39 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:35:39 user nova-compute[74836]:       <target dev="tap778fc191-db"/>
Nov 14 03:35:39 user nova-compute[74836]:     </interface>
Nov 14 03:35:39 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:35:39 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/console.log" append="off"/>
Nov 14 03:35:39 user nova-compute[74836]:     </serial>
Nov 14 03:35:39 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:35:39 user nova-compute[74836]:     <video>
Nov 14 03:35:39 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:35:39 user nova-compute[74836]:     </video>
Nov 14 03:35:39 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:35:39 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:35:39 user nova-compute[74836]:     </rng>
Nov 14 03:35:39 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:35:39 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:35:39 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:35:39 user nova-compute[74836]:     </memballoon>
Nov 14 03:35:39 user nova-compute[74836]:   </devices>
Nov 14 03:35:39 user nova-compute[74836]: </domain>
Nov 14 03:35:39 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29ba263a-2f42-4e55-b2e0-24c4b6ed3f8e req-5ed4208d-45b9-4d55-ab0e-ee866b3ab498 service nova] Releasing lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance destroyed successfully.
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:35:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:54:0b:4f, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:35:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:42 user nova-compute[74836]: WARNING nova.compute.manager [req-386bdd51-a8b3-4ecb-a101-0608f41d7c54 req-27e5317f-3d04-4e56-8790-994024c65347 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] No waiting events found dispatching network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:42 user nova-compute[74836]: WARNING nova.compute.manager [req-65395670-5d52-4def-a066-249a32ba039b req-4113c39e-d636-4bce-8897-cfef769f4b1b service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received unexpected event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 for instance with vm_state building and task_state spawning.
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:44 user nova-compute[74836]: WARNING nova.compute.manager [req-9c91f5be-78d0-446c-8abf-5147dd7051ae req-f1f173bd-630e-45b1-b1a2-71b958f3712a service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state active and task_state rescuing.
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] No waiting events found dispatching network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:35:44 user nova-compute[74836]: WARNING nova.compute.manager [req-8b749043-e588-4785-854a-3e599da3b907 req-e23c3968-4c7e-4f2e-9435-78ac42905cad service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received unexpected event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 for instance with vm_state building and task_state spawning.
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-82dc0024-cbeb-4ce8-83ae-5a64b37fda9b tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:35:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:35:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Instance spawned successfully.
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:35:45 user nova-compute[74836]: INFO nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:35:45 user nova-compute[74836]: INFO nova.compute.manager [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Took 10.99 seconds to build instance.
Nov 14 03:35:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5289713f-49c4-4661-957d-c5d164518ddb tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.125s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:35:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:35:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:35:56 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:56 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6919MB free_disk=25.129749298095703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 511e8759-a397-4300-9925-6fdf53a1631d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cc11bfda-4409-4b64-b4fe-be8acc05cf16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 063425f0-2fc0-4ece-818f-acfd647ee4fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:35:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:35:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:03 user nova-compute[74836]: INFO nova.compute.manager [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Terminating instance
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-unplugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] No waiting events found dispatching network-vif-unplugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-fc71900b-bc16-4326-af66-e341382b3f5c req-d00076a9-cfb6-4f29-81ee-cb6b75b40831 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-unplugged-dfde399e-0335-4d95-8748-78208e219b15 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Instance destroyed successfully.
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'resources' on Instance uuid cc11bfda-4409-4b64-b4fe-be8acc05cf16 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797110830',display_name='tempest-VolumesAdminNegativeTest-server-797110830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797110830',id=16,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-3vflyawa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:34:16Z,user_data=None,user_id='b140c51aa00346a087a73f715872fbff',uuid=cc11bfda-4409-4b64-b4fe-be8acc05cf16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "dfde399e-0335-4d95-8748-78208e219b15", "address": "fa:16:3e:a3:81:13", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfde399e-03", "ovs_interfaceid": "dfde399e-0335-4d95-8748-78208e219b15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG os_vif [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfde399e-03, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41b66a50-197d-4762-b0c7-3cb379159076) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:03 user nova-compute[74836]: INFO os_vif [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:81:13,bridge_name='br-int',has_traffic_filtering=True,id=dfde399e-0335-4d95-8748-78208e219b15,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfde399e-03')
Nov 14 03:36:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Deleting instance files /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16_del
Nov 14 03:36:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Deletion of /opt/stack/data/nova/instances/cc11bfda-4409-4b64-b4fe-be8acc05cf16_del complete
Nov 14 03:36:03 user nova-compute[74836]: INFO nova.compute.manager [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 14 03:36:03 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:36:03 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:04 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Took 0.48 seconds to deallocate network for instance.
Nov 14 03:36:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-137b2ff1-fa33-4577-8874-709ddc12204c req-ba5e6a81-8673-4e20-ae4b-2fc9a8c497a0 service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-deleted-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:36:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:04 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Deleted allocations for instance cc11bfda-4409-4b64-b4fe-be8acc05cf16
Nov 14 03:36:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a63280e5-d0ba-4709-b61d-998a11d58c53 tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.877s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] Acquiring lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] Lock "cc11bfda-4409-4b64-b4fe-be8acc05cf16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] No waiting events found dispatching network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:05 user nova-compute[74836]: WARNING nova.compute.manager [req-5b207bd4-4d6d-40e9-bc11-f18b53acaeda req-83725adc-6a42-4fa8-9fc5-6ba6aa90b7de service nova] [instance: cc11bfda-4409-4b64-b4fe-be8acc05cf16] Received unexpected event network-vif-plugged-dfde399e-0335-4d95-8748-78208e219b15 for instance with vm_state deleted and task_state None.
Nov 14 03:36:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing instance network info cache due to event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updated VIF entry in instance network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c4d13c1b-c027-4f1a-8a23-1ef2ef36f4e7 req-62b0e06d-75d5-42b7-bf1e-a4c59fcc38b1 service nova] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing instance network info cache due to event network-changed-db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] Acquiring lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] Acquired lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:07 user nova-compute[74836]: DEBUG nova.network.neutron [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Refreshing network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:08 user nova-compute[74836]: INFO nova.compute.manager [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Detaching volume fb1a41e7-8a76-42f0-b7c8-d7181fd3521c
Nov 14 03:36:08 user nova-compute[74836]: INFO nova.virt.block_device [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Attempting to driver detach volume fb1a41e7-8a76-42f0-b7c8-d7181fd3521c from mountpoint /dev/vdb
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Attempting to detach device vdb from instance 511e8759-a397-4300-9925-6fdf53a1631d from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:36:08 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:08 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:36:08 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:36:08 user nova-compute[74836]:   <serial>fb1a41e7-8a76-42f0-b7c8-d7181fd3521c</serial>
Nov 14 03:36:08 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:36:08 user nova-compute[74836]: </disk>
Nov 14 03:36:08 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:36:08 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully detached device vdb from instance 511e8759-a397-4300-9925-6fdf53a1631d from the persistent domain config.
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 511e8759-a397-4300-9925-6fdf53a1631d from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:36:08 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:08 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:36:08 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:36:08 user nova-compute[74836]:   <serial>fb1a41e7-8a76-42f0-b7c8-d7181fd3521c</serial>
Nov 14 03:36:08 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:36:08 user nova-compute[74836]: </disk>
Nov 14 03:36:08 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.network.neutron [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updated VIF entry in instance network info cache for port db74e63c-4b75-41e6-bcb2-20955d2e6da4. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.network.neutron [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [{"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ceb899ac-3f09-462d-b8ae-af8b23262835 req-001c6980-9f4d-43d6-a870-132a972e86bb service nova] Releasing lock "refresh_cache-511e8759-a397-4300-9925-6fdf53a1631d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:36:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:36:09 user nova-compute[74836]: INFO nova.compute.claims [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Claim successful on node user
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:36:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:36:10 user nova-compute[74836]: INFO nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Booting with volume 4d753188-889e-42e2-bce6-37726e61c2b8 at /dev/vda
Nov 14 03:36:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2de55e-27cd-402c-b1d2-3cce9275f9df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9ee2c-2972-42df-95d0-a4fb81bf1cbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7777ed-e7e8-491b-baef-dd30f1018df7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[75810a0f-7c25-485d-b98f-580843ba3831]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:10 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd167f-04cf-41ea-86c8-7308d5abd346]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating existing volume attachment record: 4bd3a809-3e78-4346-836c-60ea2609c7d0 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:10 user nova-compute[74836]: DEBUG nova.policy [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0c1105fdf7f459ba0d6e41e8d1c27d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0f68c77b03b49d392e0209cd71a8a15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:36:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully created port: d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:36:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully created port: 82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:36:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully created port: 3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:36:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully created port: 8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:36:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully created port: 69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-d1859093-60a0-4bff-813d-43cabfaf9304. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:14 user nova-compute[74836]: INFO nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Booting with volume 9332009e-2a2e-43ce-a54a-17cf8b9d4949 at /dev/vdb
Nov 14 03:36:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e976086-eb85-42e7-af9b-877128b8582e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93064ffc-8d16-4b28-84ee-1b6b6aa467d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e88ffb-52e0-4f62-a40e-dab276cf4d40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f0d71f-7e7c-484a-8b60-e0a5dd122d76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:15 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8055a0-7b18-4aeb-814b-8177b9df068d]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating existing volume attachment record: f26ac48a-3033-44a8-94b5-6cf29ef5e55a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-06c6aca3-839e-467f-a39d-4273742e2331 req-17fd8e31-0e96-4bda-ad2c-9d4fe0c14fc9 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: 4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-4743b0a2-6d81-4b8f-833e-27d5976c7d21. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port 4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: 82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-af053bf8-f486-4dca-be07-4e47c5faf34b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-49fdc20d-9fa8-430a-a14d-263adc5637f3 req-f81de231-df69-46b5-903f-df07c6d4da93 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: 3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: 8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-82be23d7-eb26-49c8-840a-5174f579f383. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:18 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port 82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Successfully updated port: 69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:19 user nova-compute[74836]: INFO nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Booting with volume 6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 at /dev/vdc
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc4b1e8-43bf-4f8f-a737-5039cdde68c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbae07d-38d3-4df6-8954-b70bc0bd4c8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ceb233-42f8-44af-95fc-8e9761137e38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef611a3b-9bc8-4913-8464-93cb4cb343b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-3d582c9b-44e0-4c71-b74a-2abe31e30287. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port 3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:19 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7d2385-1860-4c09-a6d3-1b464d612604]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG os_brick.utils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating existing volume attachment record: 70b19603-1afd-4cec-afb8-48e322462596 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-8bc42965-d5bc-4fef-981e-ba718a5d8ec8. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port 8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7129c0e8-b328-4096-9254-0e0b206753d3 req-b1ceaab9-4ec9-49d5-b448-9542d5e3bba7 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:36:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:36:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-69a7e5be-b7ed-48e5-9f40-f89745f195c6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance network_info: |[{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:36:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:22 user nova-compute[74836]: DEBUG nova.network.neutron [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port 69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:23 user nova-compute[74836]: DEBUG nova.network.neutron [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updated VIF entry in instance network info cache for port 69a7e5be-b7ed-48e5-9f40-f89745f195c6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:23 user nova-compute[74836]: DEBUG nova.network.neutron [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f23a87a3-788d-4022-bfa2-5a63e5538396 req-d8c4212e-63f1-4093-ba70-d3d28e77f0fc service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:36:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Creating image(s)
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Ensure instance console log exists: /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Start _get_guest_xml network_info=[{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmBwZzYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6', 'attached_at': '', 'detached_at': '', 'volume_id': '4d753188-889e-42e2-bce6-37726e61c2b8', 'serial': '4d753188-889e-42e2-bce6-37726e61c2b8'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '4bd3a809-3e78-4346-836c-60ea2609c7d0', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSOczMuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6', 'attached_at': '', 'detached_at': '', 'volume_id': '9332009e-2a2e-43ce-a54a-17cf8b9d4949', 'serial': '9332009e-2a2e-43ce-a54a-17cf8b9d4949'}, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'f26ac48a-3033-44a8-94b5-6cf29ef5e55a', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WARnygup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6', 'attached_at': '', 'detached_at': '', 'volume_id': '6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 'serial': '6d4fe1b9-7978-41c1-b972-c1d4f79b3c97'}, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': '70b19603-1afd-4cec-afb8-48e322462596', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:36:24 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:36:24 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmBwZzYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:24 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:24 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:24 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7414292-fbe8-4ab9-98fd-26cba7aeb9fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:24 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[126bcf1a-c2f1-4a18-ac9a-611636ea1ec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8] added
Nov 14 03:36:24 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a36500-b658-498a-bb3d-811e9c4304c5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59c340-a69c-44b2-8458-f72ea8632f8e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmBwZzYg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xmBwZzYg" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1728a444-ba9e-4401-96c9-a56ee71d6c2b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xmBwZzYg'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9517b8ae-d649-4dd1-9965-9010e0210dd7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d6846-e0b9-4dae-a02e-8986e82a761d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:24 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:24 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:24 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:24 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:24 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:24 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b9b2c-c957-47fd-98fc-be1dcf2b4d1c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260]
Nov 14 03:36:24 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:24 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88a0624-09d5-47e7-8728-d776309d8633]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd5b384-6be0-4cf5-a206-1ba9b285e643]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cca8b48-7e19-4584-bb55-5b4fbce5c53c]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmBwZzYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23934623437613931', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934623437613931', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSOczMuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:26 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:26 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:26 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa2ebf4-43ab-4caa-b934-ce9eb205dff2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:26 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabfb54-23be-4fba-804e-783290bb2267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949] added
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a5f16-9511-4c37-986b-38fde18f997e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffe231f-002f-4551-a03e-e4af32481592]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSOczMuN {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FSOczMuN" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6a32b-030c-441f-8456-e81873a6066b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FSOczMuN'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebdeeed-1e68-42ac-b878-017a53211062]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa34a91-a095-4698-94ba-be15a1b0fa2f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33de14a-4b21-455d-9fd1-49c2d4d6de87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260]
Nov 14 03:36:26 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152e2a3-9bf6-4499-a706-d400cc822976]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3550bfef-645d-4381-98ff-f35ca59f0d63]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cd5ee2-2568-4c0f-8f65-0051b9b1f68e]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSOczMuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26361326334316339', 'path': '/dev/sdf'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361326334316339', 'path': '/dev/sdf'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WARnygup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:27 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:27 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:27 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a341c5c-53ff-47f0-a91f-da3f64beb128]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:27 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc31e98-19d0-4422-b2fc-0ae4b4983048]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97] added
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83bbd4-43e9-42d5-bec0-7cae9f909d0f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02a797-d1e4-4ba6-be19-ca99c5246f3b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WARnygup {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WARnygup" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fa9552-e4f6-43e3-90db-41f05bcb0e90]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WARnygup'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c49b673-9c8f-4614-bd54-3a75445a24d2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[184eec04-285b-43ba-8d78-99127780a006]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7348fc-d054-4aa2-82c8-1e3b5c7c241a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260]
Nov 14 03:36:27 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d8ffc-7d30-44ab-946d-5fb0129c1246]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[079cc237-8e4a-4e42-9e78-7bcbf2e5565c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab2e31-4381-412b-b68a-90b0de9dd8b1]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:28 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 511e8759-a397-4300-9925-6fdf53a1631d is timed out.
Nov 14 03:36:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully detached device vdb from instance 511e8759-a397-4300-9925-6fdf53a1631d from the live domain config.
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MuIqbcjJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:28 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WARnygup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26266616337336130', 'path': '/dev/sdg'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266616337336130', 'path': '/dev/sdg'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.113s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.objects.instance [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lazy-loading 'pci_devices' on Instance uuid a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e3fdaa-5c06-470d-844a-f6203ee57782]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:36:28 user nova-compute[74836]: No targets found.
Nov 14 03:36:28 user nova-compute[74836]: iSNS:
Nov 14 03:36:28 user nova-compute[74836]: No targets found.
Nov 14 03:36:28 user nova-compute[74836]: STATIC:
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace
Nov 14 03:36:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:28 user nova-compute[74836]: FIRMWARE:
Nov 14 03:36:28 user nova-compute[74836]: No targets found.
Nov 14 03:36:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:36:28 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:36:28 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:36:28 user nova-compute[74836]:   <uuid>a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6</uuid>
Nov 14 03:36:28 user nova-compute[74836]:   <name>instance-00000016</name>
Nov 14 03:36:28 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:36:28 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:36:28 user nova-compute[74836]:   <metadata>
Nov 14 03:36:28 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:36:28 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:name>tempest-device-tagging-server-1880270170</nova:name>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:36:24</nova:creationTime>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:36:28 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:36:28 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:owner>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:user uuid="f0c1105fdf7f459ba0d6e41e8d1c27d1">tempest-TaggedBootDevicesTest-2108049424-project-member</nova:user>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:project uuid="a0f68c77b03b49d392e0209cd71a8a15">tempest-TaggedBootDevicesTest-2108049424</nova:project>
Nov 14 03:36:28 user nova-compute[74836]:       </nova:owner>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:36:28 user nova-compute[74836]:       <nova:ports>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="d1859093-60a0-4bff-813d-43cabfaf9304">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="4743b0a2-6d81-4b8f-833e-27d5976c7d21">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="af053bf8-f486-4dca-be07-4e47c5faf34b">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="82be23d7-eb26-49c8-840a-5174f579f383">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.230" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="3d582c9b-44e0-4c71-b74a-2abe31e30287">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.1.1.53" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="8bc42965-d5bc-4fef-981e-ba718a5d8ec8">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:         <nova:port uuid="69a7e5be-b7ed-48e5-9f40-f89745f195c6">
Nov 14 03:36:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 03:36:28 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:28 user nova-compute[74836]:       </nova:ports>
Nov 14 03:36:28 user nova-compute[74836]:     </nova:instance>
Nov 14 03:36:28 user nova-compute[74836]:   </metadata>
Nov 14 03:36:28 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:36:28 user nova-compute[74836]:     <system>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="serial">a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6</entry>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="uuid">a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6</entry>
Nov 14 03:36:28 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:36:28 user nova-compute[74836]:     </system>
Nov 14 03:36:28 user nova-compute[74836]:   </sysinfo>
Nov 14 03:36:28 user nova-compute[74836]:   <os>
Nov 14 03:36:28 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:36:28 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:36:28 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:36:28 user nova-compute[74836]:   </os>
Nov 14 03:36:28 user nova-compute[74836]:   <features>
Nov 14 03:36:28 user nova-compute[74836]:     <acpi/>
Nov 14 03:36:28 user nova-compute[74836]:     <apic/>
Nov 14 03:36:28 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:36:28 user nova-compute[74836]:   </features>
Nov 14 03:36:28 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:36:28 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:36:28 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:36:28 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:36:28 user nova-compute[74836]:   </clock>
Nov 14 03:36:28 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:36:28 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:36:28 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:36:28 user nova-compute[74836]:   </cpu>
Nov 14 03:36:28 user nova-compute[74836]:   <devices>
Nov 14 03:36:28 user nova-compute[74836]:     <disk type="file" device="cdrom">
Nov 14 03:36:28 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 03:36:28 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/disk.config"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="hda" bus="ide"/>
Nov 14 03:36:28 user nova-compute[74836]:     </disk>
Nov 14 03:36:28 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:36:28 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:28 user nova-compute[74836]:       <source dev="/dev/sde"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <serial>4d753188-889e-42e2-bce6-37726e61c2b8</serial>
Nov 14 03:36:28 user nova-compute[74836]:     </disk>
Nov 14 03:36:28 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:36:28 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:28 user nova-compute[74836]:       <source dev="/dev/sdf"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <serial>9332009e-2a2e-43ce-a54a-17cf8b9d4949</serial>
Nov 14 03:36:28 user nova-compute[74836]:     </disk>
Nov 14 03:36:28 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:36:28 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:28 user nova-compute[74836]:       <source dev="/dev/sdg"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="vdc" bus="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <serial>6d4fe1b9-7978-41c1-b972-c1d4f79b3c97</serial>
Nov 14 03:36:28 user nova-compute[74836]:     </disk>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:c0:72:f2"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tapd1859093-60"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:84:6b:ce"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tap4743b0a2-6d"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:72:82:d7"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tapaf053bf8-f4"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:74:05:97"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tap82be23d7-eb"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:09:87:c4"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tap3d582c9b-44"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:18:a1:05"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tap8bc42965-d5"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:28 user nova-compute[74836]:       <mac address="fa:16:3e:28:55:d8"/>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:28 user nova-compute[74836]:       <target dev="tap69a7e5be-b7"/>
Nov 14 03:36:28 user nova-compute[74836]:     </interface>
Nov 14 03:36:28 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:36:28 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/console.log" append="off"/>
Nov 14 03:36:28 user nova-compute[74836]:     </serial>
Nov 14 03:36:28 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:36:28 user nova-compute[74836]:     <video>
Nov 14 03:36:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:28 user nova-compute[74836]:     </video>
Nov 14 03:36:28 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:36:28 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:36:28 user nova-compute[74836]:     </rng>
Nov 14 03:36:28 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:36:28 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:36:28 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:36:28 user nova-compute[74836]:     </memballoon>
Nov 14 03:36:28 user nova-compute[74836]:   </devices>
Nov 14 03:36:28 user nova-compute[74836]: </domain>
Nov 14 03:36:28 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca31d9-1a02-494e-b424-79811a5da70d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15ca6da1-55e6-5c8a-b678-1c24eb22fae9', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1859093-60, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1859093-60, col_values=(('qos', UUID('b313e384-5a19-478e-babd-2561b06b1514')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1859093-60, col_values=(('external_ids', {'iface-id': 'd1859093-60a0-4bff-813d-43cabfaf9304', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:72:f2', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60')
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[910b5634-1074-4656-a2c3-ee67a8155e96]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b0ccfb2-dc74-550e-9dee-4c6b20fe6b32', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:28 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4237490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4743b0a2-6d, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4743b0a2-6d, col_values=(('qos', UUID('32eae718-93a1-4ab3-9b41-5e810eac5401')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4743b0a2-6d, col_values=(('external_ids', {'iface-id': '4743b0a2-6d81-4b8f-833e-27d5976c7d21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:6b:ce', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c6478c-1bf7-4a2c-83d2-091a2fe4fad2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d')
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0651c2-70ca-471f-bd18-c70e6053f24b]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41bb2498-c530-56bc-bf82-018942853910', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b033a3c-1415-4ef2-9076-6399df11dc95]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:36:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf053bf8-f4, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf053bf8-f4, col_values=(('qos', UUID('fdb038f0-d744-4ef4-ade6-182695f17485')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf053bf8-f4, col_values=(('external_ids', {'iface-id': 'af053bf8-f486-4dca-be07-4e47c5faf34b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:82:d7', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f457c49c-4b02-4469-b59b-42b86f8febd8]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4')
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9892fc88-0b76-59a8-ab3e-7e728e1b6b31', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b41a2-7c6f-45b2-a6fa-dc53d7261294]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82be23d7-eb, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82be23d7-eb, col_values=(('qos', UUID('14038489-2f9c-44ae-93c4-0229866eca74')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82be23d7-eb, col_values=(('external_ids', {'iface-id': '82be23d7-eb26-49c8-840a-5174f579f383', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:05:97', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb')
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[944eb257-ca22-4192-b50c-4aa379b9d4c3]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260]
Nov 14 03:36:29 user nova-compute[74836]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:29 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7240ebc3-ee35-5645-b499-845c0b885101', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb1a41e7-8a76-42f0-b7c8-d7181fd3521c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[80da9aa9-4aa8-4be6-93bc-66c19143ff7b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== disconnect_volume: return (485ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d582c9b-44, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d582c9b-44, col_values=(('qos', UUID('a0df12fd-b78e-40e3-8bee-f535bb7f660a')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d582c9b-44, col_values=(('external_ids', {'iface-id': '3d582c9b-44e0-4c71-b74a-2abe31e30287', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:87:c4', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44')
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92e01722-4835-57de-9c5f-a719ab1728bc', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bc42965-d5, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8bc42965-d5, col_values=(('qos', UUID('51e8edf8-236f-4428-bb5a-f4a2903817fd')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8bc42965-d5, col_values=(('external_ids', {'iface-id': '8bc42965-d5bc-4fef-981e-ba718a5d8ec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:a1:05', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5')
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b943ea65-fef7-5f59-9b9b-c131787a1ce6', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69a7e5be-b7, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69a7e5be-b7, col_values=(('qos', UUID('7435f2b3-1328-49cd-8117-f176572c5e8b')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69a7e5be-b7, col_values=(('external_ids', {'iface-id': '69a7e5be-b7ed-48e5-9f40-f89745f195c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:55:d8', 'vm-uuid': 'a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:29 user nova-compute[74836]: INFO os_vif [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7')
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] No BDM found with device name hda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] No VIF found with MAC fa:16:3e:c0:72:f2, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] No VIF found with MAC fa:16:3e:09:87:c4, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:36:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Using config drive
Nov 14 03:36:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Creating config drive at /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/disk.config
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyr0j37k3 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyr0j37k3" returned: 0 in 0.050s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf4d259f-299d-4013-a8c6-ecd29863bdd9 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:31 user nova-compute[74836]: WARNING nova.compute.manager [req-6c1f9e17-8d88-4ad8-95e2-2e36bf238c6b req-db526670-cf6c-42d5-a97b-5191ca4931a0 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 for instance with vm_state building and task_state spawning.
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-1765a7ac-33b9-4574-976a-5b94754ef886 req-e432e41c-91ca-4b5c-8d34-0c166611d36f service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-283da5a9-5339-4392-9296-697ef2c119a1 req-82fd90f8-4a66-415b-9820-8882fdd2a5f3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-9ff3a33f-7f5c-4389-aa6d-2b933e5aa2e5 req-ff400597-752d-48a6-bc37-86b0516c2f96 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'flavor' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:33 user nova-compute[74836]: WARNING nova.compute.manager [req-ff564cdb-9698-4ffc-9c6b-94ecdae1def8 req-d1371c35-951d-4b7f-ad20-8119e9f81b08 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 for instance with vm_state building and task_state spawning.
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:34 user nova-compute[74836]: INFO nova.compute.manager [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attaching volume 8500e651-7975-4b9a-8797-74d00c4952c1 to /dev/vdb
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3340f0d-b68f-40f0-9a05-06f2789e6227]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396c91a-a8fb-401f-bea3-6dddc1cff4c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e36fba9-ed41-4905-b6ad-5d024d55c237]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0100c8b-0db2-4220-bf66-a09617a4573c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:34 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ad8b55-e59c-44fd-88e4-48f085e22dfd]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating existing volume attachment record: 6fae9c32-971e-423f-bb18-f34fd6105b38 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:34 user nova-compute[74836]: WARNING nova.compute.manager [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b for instance with vm_state building and task_state spawning.
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-changed-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Refreshing instance network info cache due to event network-changed-b5f1b174-ff03-4f85-9de9-caf34175b732. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Acquiring lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Acquired lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Refreshing network info cache for port b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updated VIF entry in instance network info cache for port b5f1b174-ff03-4f85-9de9-caf34175b732. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating instance_info_cache with network_info: [{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a19926e2-84cc-4d6b-8994-766229ceef97 req-3e2f1f15-69f0-430e-ac3c-84c70093f280 service nova] Releasing lock "refresh_cache-c340e46d-8444-46be-a47f-13e9b91698a4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:36:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance spawned successfully.
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:35 user nova-compute[74836]: INFO nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Took 11.17 seconds to spawn the instance on the hypervisor.
Nov 14 03:36:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:36:35 user nova-compute[74836]: INFO nova.compute.manager [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Took 26.45 seconds to build instance.
Nov 14 03:36:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39f43c0a-2f05-491f-a3cf-92da45aaa8d0 tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.543s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:36 user nova-compute[74836]: WARNING nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 for instance with vm_state active and task_state None.
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:36 user nova-compute[74836]: WARNING nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 for instance with vm_state active and task_state None.
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:36 user nova-compute[74836]: WARNING nova.compute.manager [req-ec37dbff-104c-41cc-a16e-6ecef1f841d1 req-eea10b2a-2170-41bc-9739-7a4e86e4d62d service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 for instance with vm_state active and task_state None.
Nov 14 03:36:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:39 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd98a6-b182-4cd2-a734-1246cb7d69f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:39 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[185057a8-b0d0-41a7-8492-8c86e9ce1a9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1] added
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d0107f-d7e7-4dc6-a145-6f94da6242d8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d281d-7f83-4d4b-9fef-31c5ba10765a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMzVEqx {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMzVEqx" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32b0a4-b8df-4ff9-8c53-37adf3976c61]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpMzVEqx'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847ada5-4a58-4859-a92e-9219649e8b70]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[136924f7-aa07-4127-80b3-2bf54120529d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed9e5f5-e798-4cc0-aa44-6a4c974d1bf4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]
Nov 14 03:36:39 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[353e8c71-3ad5-4fc8-833f-cb0d016f347f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70c84f-ec6f-43cd-ae00-9b6fdf8bbe8a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] HCTL ('40', '-', '-', 0) found on session 20 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a058ab-6f97-4760-82ee-7b9aa410996a]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching for a device in session 20 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23237326563626332', 'path': '/dev/sdi'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237326563626332', 'path': '/dev/sdi'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'flavor' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:36:40 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:40 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:36:40 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:36:40 user nova-compute[74836]:   <serial>8500e651-7975-4b9a-8797-74d00c4952c1</serial>
Nov 14 03:36:40 user nova-compute[74836]: </disk>
Nov 14 03:36:40 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:74:0e:44, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-changed-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Refreshing instance network info cache due to event network-changed-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] Acquiring lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] Acquired lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Refreshing network info cache for port 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5885ae8c-6d11-4fe2-8a0c-9c4de2abfbfd tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.132s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updated VIF entry in instance network info cache for port 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating instance_info_cache with network_info: [{"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-198cf827-a580-414c-a518-c0fbe1c9e2bc req-b158fd37-f812-4092-bae6-65722957998b service nova] Releasing lock "refresh_cache-a6de739b-56d4-4d9c-99b5-0228b8ef5c82" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:36:42 user nova-compute[74836]: INFO nova.compute.manager [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Rebuilding instance
Nov 14 03:36:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:36:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:43 user nova-compute[74836]: WARNING nova.compute.manager [req-ec0ebc62-d9b7-4fd8-bd23-1ecc51be6689 req-3ef00738-dabe-4169-a09c-2adff9c120ac service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state active and task_state rebuilding.
Nov 14 03:36:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance destroyed successfully.
Nov 14 03:36:43 user nova-compute[74836]: INFO nova.compute.manager [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Detaching volume 8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:36:44 user nova-compute[74836]: INFO nova.virt.block_device [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attempting to driver detach volume 8500e651-7975-4b9a-8797-74d00c4952c1 from mountpoint /dev/vdb
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Attempting to detach device vdb from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:36:44 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:44 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:36:44 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:36:44 user nova-compute[74836]:   <serial>8500e651-7975-4b9a-8797-74d00c4952c1</serial>
Nov 14 03:36:44 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:36:44 user nova-compute[74836]: </disk>
Nov 14 03:36:44 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:36:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully detached device vdb from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the persistent domain config.
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:44 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e964afb-124f-436c-9cb1-36990addd91b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:36:44 user nova-compute[74836]: No targets found.
Nov 14 03:36:44 user nova-compute[74836]: iSNS:
Nov 14 03:36:44 user nova-compute[74836]: No targets found.
Nov 14 03:36:44 user nova-compute[74836]: STATIC:
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace
Nov 14 03:36:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:44 user nova-compute[74836]: FIRMWARE:
Nov 14 03:36:44 user nova-compute[74836]: No targets found.
Nov 14 03:36:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:36:44 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:36:44 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b8e75d-bdae-46ca-a811-fe32f7470ece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[571943d1-4855-4f3d-931d-4f0b8c7e00d3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e45bb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1'): ({'sdi'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Removing single pathed devices sdi {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6496357-29a2-45b9-8d53-4a3294f0bd29]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd050cfb-5f9b-4b76-ab70-ba126209d775]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flushing IO for device /dev/sdi {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dfd3cf-7a9c-4c3a-9575-7bcea7bcad72]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[391a99c6-8bee-4a58-9c96-0a66e1d990a0]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:44 user nova-compute[74836]: INFO nova.compute.manager [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attaching volume 46413db8-7360-43b2-9791-b56c830959b2 to /dev/vdb
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7b2b25-15fe-4f1e-a46e-235338dd52d6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.utils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2e8b77-6dbe-43e4-be74-1890f31d4731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b625936b-1418-4d42-a2d8-496d1e42db10]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]
Nov 14 03:36:44 user nova-compute[74836]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d2de1f-5b92-452b-b524-23e1add8f7df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8f3a28-fd7b-4882-8dca-97982217ddac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab515a3-5f0b-4a05-90dd-a53fed02fe69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[66545cf5-e59d-4791-85fe-c1f084deca46]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== disconnect_volume: return (421ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:44 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2f21b6-f344-4844-952a-c097208edc85]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG os_brick.utils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:44 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating existing volume attachment record: 1d64b9f9-267e-4ea7-a2e8-39c158114c84 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:45 user nova-compute[74836]: WARNING nova.compute.manager [req-1768413c-0087-4b0b-adce-3d88f1d061fe req-d3d70827-e48e-4001-8902-9f34d7fac9dd service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state active and task_state rebuilding.
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance destroyed successfully.
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-ServerActionsTestOtherA-server-1516910690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f1b174-ff, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93c723c2-2ff9-4234-9ba9-623643ed1fff) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:45 user nova-compute[74836]: INFO os_vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff')
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc08388-5c89-4f39-afef-5bbcb6aa1798]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:36:45 user nova-compute[74836]: No targets found.
Nov 14 03:36:45 user nova-compute[74836]: iSNS:
Nov 14 03:36:45 user nova-compute[74836]: No targets found.
Nov 14 03:36:45 user nova-compute[74836]: STATIC:
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace
Nov 14 03:36:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:45 user nova-compute[74836]: FIRMWARE:
Nov 14 03:36:45 user nova-compute[74836]: No targets found.
Nov 14 03:36:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:36:45 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:36:45 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3fd34a-356d-42fa-8b0f-8ec740f94a32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9513da29-89c5-4f56-ae6a-f0e74a3c120f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cf33125-e10a-493c-8089-57338d574ace (non-flash)
Nov 14 03:36:45 user nova-compute[74836]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3010aef-28af-4ef2-ac59-9a686a84bbf8 (non-flash)
Nov 14 03:36:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43776d0>, {}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Disconnecting from: [] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== disconnect_volume: return (97ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:36:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Deleting instance files /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4_del
Nov 14 03:36:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Deletion of /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4_del complete
Nov 14 03:36:45 user nova-compute[74836]: INFO nova.virt.block_device [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Booting with volume 8500e651-7975-4b9a-8797-74d00c4952c1 at /dev/vdb
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.utils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a734f-cf7f-4247-a6a2-e0a30200afe3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fab0cd-d265-4463-9561-20650865d8b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[03550017-e3f1-4097-8592-88586f2a9a03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccece7d-43ef-4c62-992b-06512aeea088]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:45 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc6ed35-33c4-4a4c-a17d-2983f7abb996]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG os_brick.utils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating existing volume attachment record: aa91c839-8178-44fb-8b9b-902857dddd8a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:45 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:36:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOkSumCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:49 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:49 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:49 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ef039-3268-480a-9e1c-eb11fccc4a2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:49 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bedf7d-9abd-4e88-84b0-8ec70e5b25ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2] added
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c275495a-7569-469e-bc83-a59409eda763]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1591088f-23c8-4b2a-93a3-2323bbeab4b6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOkSumCr {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yOkSumCr" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[44623406-c2d5-45ce-905b-26f9b371781e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yOkSumCr'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6485482-9f98-40b5-964c-c47b9bab2d74]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc8dbe0-90c3-4274-9de6-e0252179e8a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c4aa25-a508-48a7-81e3-0a67164f02c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260]
Nov 14 03:36:49 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591a4a9-5c4a-4032-b274-164f481112e1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f73ea-1d76-428d-9f73-52350628af25]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:49 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b91bbd-d4e8-48db-a5ee-64c01d63736c]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOkSumCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23463616661373736', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463616661373736', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:36:50 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:50 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:36:50 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:36:50 user nova-compute[74836]:   <serial>46413db8-7360-43b2-9791-b56c830959b2</serial>
Nov 14 03:36:50 user nova-compute[74836]: </disk>
Nov 14 03:36:50 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:36:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Creating image(s)
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [{"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-a767ef19-4fe9-4854-aa8f-f769b5d13378" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:50 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No VIF found with MAC fa:16:3e:90:40:c3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bbf57a0a-13fc-487a-ad82-4870aab7e55b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.947s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk 1073741824" returned: 0 in 0.088s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Cannot resize image /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Ensure instance console log exists: /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start _get_guest_xml network_info=[{"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c340e46d-8444-46be-a47f-13e9b91698a4', 'attached_at': '', 'detached_at': '', 'volume_id': '8500e651-7975-4b9a-8797-74d00c4952c1', 'serial': '8500e651-7975-4b9a-8797-74d00c4952c1'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'aa91c839-8178-44fb-8b9b-902857dddd8a', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:36:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 03:36:51 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'vcpu_model' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:51 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:51 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:51 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8954535-07be-44c4-a473-e9ad9a206d6a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:36:51 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c2f7e-dd33-42c0-9fd5-d33e6917dea4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1] added
Nov 14 03:36:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fadc4c-aea6-4161-85bd-10ef447085c8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[125bce17-7871-4808-b80a-fdae64a9b287]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMzVEqx {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpMzVEqx" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d095ee-df65-466b-bacd-0a1a1df06bdb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpMzVEqx'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0691f8e2-d146-4c4b-82f2-9742214fc742]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fea53b1-fe9c-4953-92ea-47bfa0a2af62]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-changed-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Refreshing instance network info cache due to event network-changed-ca953ed5-26d8-4999-b18c-e474e652351e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] Acquiring lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] Acquired lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Refreshing network info cache for port ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f92746-5c9d-4305-b38c-044d73c85958]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]
Nov 14 03:36:52 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:52 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[80479558-717b-492c-a354-b4d8341604a1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c96d53-cf39-4910-8906-ef71b79045a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:52 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] HCTL ('39', '-', '-', 0) found on session 22 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0fb922-09e5-42af-b11a-3f4fc6379192]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching for a device in session 22 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updated VIF entry in instance network info cache for port ca953ed5-26d8-4999-b18c-e474e652351e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating instance_info_cache with network_info: [{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48311d47-542e-4e01-8866-d316d229593a req-fb200992-522d-43da-9fe4-212bac2452c9 service nova] Releasing lock "refresh_cache-063425f0-2fc0-4ece-818f-acfd647ee4fb" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== connect_volume: return (1528ms) {'type': 'block', 'scsi_wwn': '23237326563626332', 'path': '/dev/sdh'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237326563626332', 'path': '/dev/sdh'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-ServerActionsTestOtherA-server-1516910690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:36:53 user nova-compute[74836]:   <uuid>c340e46d-8444-46be-a47f-13e9b91698a4</uuid>
Nov 14 03:36:53 user nova-compute[74836]:   <name>instance-00000011</name>
Nov 14 03:36:53 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:36:53 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:36:53 user nova-compute[74836]:   <metadata>
Nov 14 03:36:53 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:36:53 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherA-server-1516910690</nova:name>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:36:51</nova:creationTime>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:36:53 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:36:53 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:owner>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:user uuid="f9aff38e58fe4a1b8bd4d46ceda55ba3">tempest-ServerActionsTestOtherA-585001335-project-member</nova:user>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:project uuid="06e7a009680c4c6d80ab5bb26d05b100">tempest-ServerActionsTestOtherA-585001335</nova:project>
Nov 14 03:36:53 user nova-compute[74836]:       </nova:owner>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:36:53 user nova-compute[74836]:       <nova:ports>
Nov 14 03:36:53 user nova-compute[74836]:         <nova:port uuid="b5f1b174-ff03-4f85-9de9-caf34175b732">
Nov 14 03:36:53 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:36:53 user nova-compute[74836]:         </nova:port>
Nov 14 03:36:53 user nova-compute[74836]:       </nova:ports>
Nov 14 03:36:53 user nova-compute[74836]:     </nova:instance>
Nov 14 03:36:53 user nova-compute[74836]:   </metadata>
Nov 14 03:36:53 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:36:53 user nova-compute[74836]:     <system>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="serial">c340e46d-8444-46be-a47f-13e9b91698a4</entry>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="uuid">c340e46d-8444-46be-a47f-13e9b91698a4</entry>
Nov 14 03:36:53 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:36:53 user nova-compute[74836]:     </system>
Nov 14 03:36:53 user nova-compute[74836]:   </sysinfo>
Nov 14 03:36:53 user nova-compute[74836]:   <os>
Nov 14 03:36:53 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:36:53 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:36:53 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:36:53 user nova-compute[74836]:   </os>
Nov 14 03:36:53 user nova-compute[74836]:   <features>
Nov 14 03:36:53 user nova-compute[74836]:     <acpi/>
Nov 14 03:36:53 user nova-compute[74836]:     <apic/>
Nov 14 03:36:53 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:36:53 user nova-compute[74836]:   </features>
Nov 14 03:36:53 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:36:53 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:36:53 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:36:53 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:36:53 user nova-compute[74836]:   </clock>
Nov 14 03:36:53 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:36:53 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:36:53 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:36:53 user nova-compute[74836]:   </cpu>
Nov 14 03:36:53 user nova-compute[74836]:   <devices>
Nov 14 03:36:53 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:36:53 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:36:53 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk"/>
Nov 14 03:36:53 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:36:53 user nova-compute[74836]:     </disk>
Nov 14 03:36:53 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:36:53 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:36:53 user nova-compute[74836]:       <source dev="/dev/sdh"/>
Nov 14 03:36:53 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:36:53 user nova-compute[74836]:       <serial>8500e651-7975-4b9a-8797-74d00c4952c1</serial>
Nov 14 03:36:53 user nova-compute[74836]:     </disk>
Nov 14 03:36:53 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:36:53 user nova-compute[74836]:       <mac address="fa:16:3e:74:0e:44"/>
Nov 14 03:36:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:53 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:36:53 user nova-compute[74836]:       <target dev="tapb5f1b174-ff"/>
Nov 14 03:36:53 user nova-compute[74836]:     </interface>
Nov 14 03:36:53 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:36:53 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/console.log" append="off"/>
Nov 14 03:36:53 user nova-compute[74836]:     </serial>
Nov 14 03:36:53 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:36:53 user nova-compute[74836]:     <video>
Nov 14 03:36:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:36:53 user nova-compute[74836]:     </video>
Nov 14 03:36:53 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:36:53 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:36:53 user nova-compute[74836]:     </rng>
Nov 14 03:36:53 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:36:53 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:36:53 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:36:53 user nova-compute[74836]:     </memballoon>
Nov 14 03:36:53 user nova-compute[74836]:   </devices>
Nov 14 03:36:53 user nova-compute[74836]: </domain>
Nov 14 03:36:53 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-ServerActionsTestOtherA-server-1516910690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:34:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG os_vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b75539b8-ddd3-52e5-87ab-306c1272ef0f', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5f1b174-ff, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5f1b174-ff, col_values=(('qos', UUID('e312d4fd-e0f8-446c-bc2b-49dc5ade9fe8')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5f1b174-ff, col_values=(('external_ids', {'iface-id': 'b5f1b174-ff03-4f85-9de9-caf34175b732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:0e:44', 'vm-uuid': 'c340e46d-8444-46be-a47f-13e9b91698a4'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:53 user nova-compute[74836]: INFO os_vif [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff')
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:53 user nova-compute[74836]: INFO nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Rebuilding instance
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:74:0e:44, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:54 user nova-compute[74836]: WARNING nova.compute.manager [req-e02d874e-7dd6-4d77-9b59-d8bea9a930a6 req-e3777910-e912-4a6b-8d51-77c8dd963f37 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state active and task_state rebuilding.
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance destroyed successfully.
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance destroyed successfully.
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1441202584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:36:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca953ed5-26, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db33a21b-867d-4454-8b0c-89dd0f2fb527) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: INFO os_vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26')
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:55 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f13090-fab7-4b9a-94c2-728fca7cdea1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:36:55 user nova-compute[74836]: No targets found.
Nov 14 03:36:55 user nova-compute[74836]: iSNS:
Nov 14 03:36:55 user nova-compute[74836]: No targets found.
Nov 14 03:36:55 user nova-compute[74836]: STATIC:
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:36:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:55 user nova-compute[74836]: FIRMWARE:
Nov 14 03:36:55 user nova-compute[74836]: No targets found.
Nov 14 03:36:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:36:55 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:36:55 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb0ede0-1840-44e0-a840-f98bf79bf623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd1a649-249e-4cb2-8801-7a73093fd995]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e45bb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8ca44-36d1-463f-a88c-a96af0ec0c38]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:55 user nova-compute[74836]: WARNING nova.compute.manager [req-a5a44d66-5d31-4032-bf97-ffe04ab6a18a req-20e405a9-98a2-447d-86cb-e60a5afece9c service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a79520a-edfb-4cdf-b15d-0c1c1b047255]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160f5a4-d88a-402e-bebb-a9dea69da7be]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c51daf9-eaad-4277-8117-e1210fece9b5]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd50b089-5798-4f41-8098-dd9f21c25a2a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[253ba542-f868-4319-8c46-71434588ca42]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]
Nov 14 03:36:56 user nova-compute[74836]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.
Nov 14 03:36:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24520012-01ea-49bb-9166-142700cc2730]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== disconnect_volume: return (495ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:36:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deleting instance files /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb_del
Nov 14 03:36:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deletion of /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb_del complete
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:56 user nova-compute[74836]: INFO nova.compute.manager [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Terminating instance
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:56 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 063425f0-2fc0-4ece-818f-acfd647ee4fb could not be found.
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:56 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7224ff4-530a-4ab2-9402-1a1ced33c024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:36:56 user nova-compute[74836]: No targets found.
Nov 14 03:36:56 user nova-compute[74836]: iSNS:
Nov 14 03:36:56 user nova-compute[74836]: No targets found.
Nov 14 03:36:56 user nova-compute[74836]: STATIC:
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:36:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:36:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:36:56 user nova-compute[74836]: FIRMWARE:
Nov 14 03:36:56 user nova-compute[74836]: No targets found.
Nov 14 03:36:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:36:56 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:36:56 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:56 user nova-compute[74836]: WARNING nova.compute.manager [req-4b9e8e19-baa6-4c4b-bbe8-e07304715400 req-c759fa82-6872-4b40-86dc-57e7f00af902 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state active and task_state rebuilding.
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3549a7-8ec6-451f-9490-38a3a46c52e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080e296-177b-4a0d-b693-eb78c42610f2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:36:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e46d52d0>, {}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Disconnecting from: [] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.111s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== disconnect_volume: return (113ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-changed-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Refreshing instance network info cache due to event network-changed-b0639cac-1a93-42db-813d-35dd094ab18e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] Acquiring lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] Acquired lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.network.neutron [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Refreshing network info cache for port b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:36:57 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:36:57 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6925MB free_disk=25.132423400878906GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Instance destroyed successfully.
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.objects.instance [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lazy-loading 'resources' on Instance uuid a767ef19-4fe9-4854-aa8f-f769b5d13378 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Preparing to wait for external event volume-reimaged-69a5eff9-c4dc-4950-a08f-7629d9c53916 {{(pid=74836) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:31:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-898931746',display_name='tempest-VolumesAdminNegativeTest-server-898931746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-898931746',id=8,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi1sBR9vjVragWKGUi5Lxx/7gqvpKdwUOPH0olvziny29MUFd/w6wmIan0RTKF/CnbaES7UpTeT94lDextEBqChJTeuOqWS/qDl6dgQMHZrtYQzNpkNVsPoVFrLukGspw==',key_name='tempest-keypair-1470069867',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f22b90ab4b5f44cd8bb9a796ea8a4c7e',ramdisk_id='',reservation_id='r-ddhabs9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2038430318',owner_user_name='tempest-VolumesAdminNegativeTest-2038430318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b140c51aa00346a087a73f715872fbff',uuid=a767ef19-4fe9-4854-aa8f-f769b5d13378,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converting VIF {"id": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "address": "fa:16:3e:ec:95:f8", "network": {"id": "1c710f53-1d49-45cc-bea6-0717a7229a7c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1475887054-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.121", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f22b90ab4b5f44cd8bb9a796ea8a4c7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb81a7dc1-60", "ovs_interfaceid": "b81a7dc1-60d9-4d8f-a556-82175a45fa82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG os_vif [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb81a7dc1-60, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64a4af32-2bda-4698-b09d-d32aa42be419) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:36:57 user nova-compute[74836]: INFO os_vif [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:95:f8,bridge_name='br-int',has_traffic_filtering=True,id=b81a7dc1-60d9-4d8f-a556-82175a45fa82,network=Network(1c710f53-1d49-45cc-bea6-0717a7229a7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb81a7dc1-60')
Nov 14 03:36:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Deleting instance files /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378_del
Nov 14 03:36:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Deletion of /opt/stack/data/nova/instances/a767ef19-4fe9-4854-aa8f-f769b5d13378_del complete
Nov 14 03:36:57 user nova-compute[74836]: INFO nova.compute.manager [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 511e8759-a397-4300-9925-6fdf53a1631d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 063425f0-2fc0-4ece-818f-acfd647ee4fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:57 user nova-compute[74836]: WARNING nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-unplugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] No waiting events found dispatching network-vif-unplugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-unplugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Acquiring lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] No waiting events found dispatching network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:36:57 user nova-compute[74836]: WARNING nova.compute.manager [req-524f9b4b-e5cc-4064-b0c0-6818ae4a62e0 req-fb35ebcf-90f4-4256-9ef1-916813d58c8f service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received unexpected event network-vif-plugged-b81a7dc1-60d9-4d8f-a556-82175a45fa82 for instance with vm_state active and task_state deleting.
Nov 14 03:36:57 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:36:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance spawned successfully.
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updated VIF entry in instance network info cache for port b0639cac-1a93-42db-813d-35dd094ab18e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating instance_info_cache with network_info: [{"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60d5557b-ddbb-46d3-a3dc-c37ffa30ddef req-8a07fc8f-7c1b-42b1-8fed-a300c8c4aa24 service nova] Releasing lock "refresh_cache-6ee0263f-76cc-41e6-bb00-ed8c61d586cc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:58 user nova-compute[74836]: INFO nova.compute.manager [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attaching volume 3613fdda-e79b-413a-a52c-410ccb1b1c93 to /dev/vdb
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.utils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9c0826-1dea-4e79-8c63-5ef4baa896b0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.083s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.449s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74836) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b23fba-ac53-4386-936b-f15735a04072]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[938cda38-d40f-47e8-a2c7-d3db31321b52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee36b04-e65a-4354-889d-5595d1d7a5c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:36:58 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e496212-b28e-437d-8a33-fabad0285676]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG os_brick.utils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating existing volume attachment record: 085058ad-e6f6-4bfc-9329-1482e7605d1e {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:36:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c4229524-618f-43bf-8433-c64603f95d14 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.148s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:59 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Took 1.41 seconds to deallocate network for instance.
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-97a24d06-18b9-4cb0-a0a6-3dc8570b12d6 req-32780a4d-8ce8-4053-b2ff-29ec9b122959 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Received event network-vif-deleted-b81a7dc1-60d9-4d8f-a556-82175a45fa82 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:36:59 user nova-compute[74836]: INFO nova.compute.manager [req-97a24d06-18b9-4cb0-a0a6-3dc8570b12d6 req-32780a4d-8ce8-4053-b2ff-29ec9b122959 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Neutron deleted interface b81a7dc1-60d9-4d8f-a556-82175a45fa82; detaching it from the instance and deleting it from the info cache
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-97a24d06-18b9-4cb0-a0a6-3dc8570b12d6 req-32780a4d-8ce8-4053-b2ff-29ec9b122959 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-97a24d06-18b9-4cb0-a0a6-3dc8570b12d6 req-32780a4d-8ce8-4053-b2ff-29ec9b122959 service nova] [instance: a767ef19-4fe9-4854-aa8f-f769b5d13378] Detach interface failed, port_id=b81a7dc1-60d9-4d8f-a556-82175a45fa82, reason: Instance a767ef19-4fe9-4854-aa8f-f769b5d13378 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:36:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.579s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:00 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Deleted allocations for instance a767ef19-4fe9-4854-aa8f-f769b5d13378
Nov 14 03:37:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-604615c8-9290-44c0-b4d6-609804ce516e tempest-VolumesAdminNegativeTest-2038430318 tempest-VolumesAdminNegativeTest-2038430318-project-member] Lock "a767ef19-4fe9-4854-aa8f-f769b5d13378" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.977s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:00 user nova-compute[74836]: INFO nova.compute.manager [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Detaching volume 46413db8-7360-43b2-9791-b56c830959b2
Nov 14 03:37:00 user nova-compute[74836]: INFO nova.virt.block_device [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attempting to driver detach volume 46413db8-7360-43b2-9791-b56c830959b2 from mountpoint /dev/vdb
Nov 14 03:37:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Attempting to detach device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:00 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:00 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:00 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:37:00 user nova-compute[74836]:   <serial>46413db8-7360-43b2-9791-b56c830959b2</serial>
Nov 14 03:37:00 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:37:00 user nova-compute[74836]: </disk>
Nov 14 03:37:00 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config.
Nov 14 03:37:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:00 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:00 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:00 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:37:00 user nova-compute[74836]:   <serial>46413db8-7360-43b2-9791-b56c830959b2</serial>
Nov 14 03:37:00 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:37:00 user nova-compute[74836]: </disk>
Nov 14 03:37:00 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:01 user nova-compute[74836]: INFO nova.compute.manager [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Terminating instance
Nov 14 03:37:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-d6803089-3ea8-41e6-9bdf-dd3d119d6af4 req-5dcfcd47-d381-4d83-905e-2589a7d83c98 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-unplugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:37:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Instance destroyed successfully.
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.objects.instance [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'resources' on Instance uuid 511e8759-a397-4300-9925-6fdf53a1631d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1817550384',display_name='tempest-TestMinimumBasicScenario-server-1817550384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1817550384',id=13,image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsFJ+En47qO4IB0nVgRo+5dz+IkqSCr6WEtsP32AVOfroOTOy3AcINuPpx5I2LilbsNu1xAgzRr+othidfTD3W2oDCN7Lgi9no7/v5hh+VU661D4jONIMlv4YvwtmqCcg==',key_name='tempest-TestMinimumBasicScenario-754542245',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-1wzoi4kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='ce8c25fb-ee6b-4f80-b055-86191a9c8143',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:34:23Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=511e8759-a397-4300-9925-6fdf53a1631d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "address": "fa:16:3e:2f:96:1b", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb74e63c-4b", "ovs_interfaceid": "db74e63c-4b75-41e6-bcb2-20955d2e6da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG os_vif [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb74e63c-4b, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3b2bfde-9120-4eb8-abaf-45c1aa0027a8) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:02 user nova-compute[74836]: INFO os_vif [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:96:1b,bridge_name='br-int',has_traffic_filtering=True,id=db74e63c-4b75-41e6-bcb2-20955d2e6da4,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb74e63c-4b')
Nov 14 03:37:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Deleting instance files /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d_del
Nov 14 03:37:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Deletion of /opt/stack/data/nova/instances/511e8759-a397-4300-9925-6fdf53a1631d_del complete
Nov 14 03:37:02 user nova-compute[74836]: INFO nova.compute.manager [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 03:37:02 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:02 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Took 0.46 seconds to deallocate network for instance.
Nov 14 03:37:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-6a109574-3779-44d4-ab79-d780f640aaa6 req-ba110935-a499-4e3b-8c5d-2fd27c6ff7a3 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-deleted-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:03 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Deleted allocations for instance 511e8759-a397-4300-9925-6fdf53a1631d
Nov 14 03:37:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95dadef5-da29-467a-85af-527f03a99e77 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "511e8759-a397-4300-9925-6fdf53a1631d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.461s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] Acquiring lock "511e8759-a397-4300-9925-6fdf53a1631d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] Lock "511e8759-a397-4300-9925-6fdf53a1631d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] No waiting events found dispatching network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:03 user nova-compute[74836]: WARNING nova.compute.manager [req-122be15b-9965-4710-9895-3e3b8d4f9684 req-39f057dc-be26-441a-a682-dc40cf256a25 service nova] [instance: 511e8759-a397-4300-9925-6fdf53a1631d] Received unexpected event network-vif-plugged-db74e63c-4b75-41e6-bcb2-20955d2e6da4 for instance with vm_state deleted and task_state None.
Nov 14 03:37:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCqYGcTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:04 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6156397f-a279-4749-8281-48fbad8d3e2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:37:04 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa42b4ea-e7e9-471e-9a7c-8fb53fc24da0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93] added
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068cefb-20eb-492d-8782-0b01c0b9792a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea899a-e5c0-4bc9-bc37-bdf8fa18c250]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCqYGcTo {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WCqYGcTo" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[435cb435-fa29-4d79-bc27-9c41fc1df88b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WCqYGcTo'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2984aa7-4f29-4006-bacc-6ca4ab3d962d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb2c359-5167-4504-8a99-fcd576cd49e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[21599f2d-df7e-49ab-8b64-f7ab32d89e40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260]
Nov 14 03:37:04 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df1cfab-e04a-4074-bb0b-65ba7a026175]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8975d2d-3ee4-4cdc-9ba8-b2e32b18acd4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f2909-9e0f-4013-8400-80fe50522c1c]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCqYGcTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26338626163636333', 'path': '/dev/sdi'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338626163636333', 'path': '/dev/sdi'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:37:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:05 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:37:05 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:37:05 user nova-compute[74836]:   <serial>3613fdda-e79b-413a-a52c-410ccb1b1c93</serial>
Nov 14 03:37:05 user nova-compute[74836]: </disk>
Nov 14 03:37:05 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:37:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No VIF found with MAC fa:16:3e:9c:fc:93, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:37:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-59d47dfc-0ce9-47af-afac-a1725d94fd8b tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.743s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:10 user nova-compute[74836]: INFO nova.compute.manager [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attaching volume 7c2d17bc-42eb-4754-b22f-513cbd79f661 to /dev/vdc
Nov 14 03:37:10 user nova-compute[74836]: DEBUG os_brick.utils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4724d3db-93a6-43c5-8cf4-31da0b1bdb28]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfdea96-6893-4a5e-9b9c-c085007a1703]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce528b-180c-46d0-9baf-3b41aad5b05e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06ce96-fd25-42ba-a963-0717b5a523bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:11 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:37:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4af1a56-2bfc-40c6-960f-68b5bad2527f]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG os_brick.utils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:11 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating existing volume attachment record: 834fa847-13ae-423a-9084-b9eab75a22f4 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:37:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-e03b7c98-84d2-4a74-9911-eaa89afcf84a req-daeb3da2-2d6a-49e8-a50a-f54f96c5c9ab service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event volume-reimaged-69a5eff9-c4dc-4950-a08f-7629d9c53916 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e03b7c98-84d2-4a74-9911-eaa89afcf84a req-daeb3da2-2d6a-49e8-a50a-f54f96c5c9ab service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e03b7c98-84d2-4a74-9911-eaa89afcf84a req-daeb3da2-2d6a-49e8-a50a-f54f96c5c9ab service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e03b7c98-84d2-4a74-9911-eaa89afcf84a req-daeb3da2-2d6a-49e8-a50a-f54f96c5c9ab service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-e03b7c98-84d2-4a74-9911-eaa89afcf84a req-daeb3da2-2d6a-49e8-a50a-f54f96c5c9ab service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Processing event volume-reimaged-69a5eff9-c4dc-4950-a08f-7629d9c53916 {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miOzvXVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:16 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90db4fc-9e2f-4478-9588-435f34d199db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:37:16 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: INFO nova.virt.block_device [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Booting with volume 69a5eff9-c4dc-4950-a08f-7629d9c53916 at /dev/vda
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded6d39-c5a0-473c-83ce-a313e9f09f28]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661] added
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea66346a-9bd9-4fa2-b77a-f2b98fe462c7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1655667-17dc-4651-aae8-4b4e4ed08a05]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v miOzvXVI {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v miOzvXVI" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ce1b52-7d3f-47de-873e-b658a021334c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'miOzvXVI'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.utils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3d25e5-4fa7-4f13-af23-5ff832889636]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f1f1b2-436f-4976-a5f3-662eb9cc9869]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d8c0af-946d-4e51-85be-ca6ea7fd2bc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c764e30-cfed-4efa-a296-af384756d56a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4a1e0f-43b9-4eaa-b3b5-9e86872d8e28]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5c41d5-6b20-48f2-b308-5b419f7b6ee9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:16 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[39970f26-f3ac-4fd7-ba1e-cf2d1346a053]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.utils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating existing volume attachment record: 55f4cd77-df16-4573-94fc-710fdb93835b {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7464996d-b409-45f4-b6b8-65a272654436]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260]
Nov 14 03:37:16 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c6d4c-2b02-41f2-ad2c-98895a004ab1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfea0c5-70a7-47ba-9e98-b8c03b03a13c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a44f38-5293-44d7-ab55-6743b90bbdf4]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miOzvXVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26334333735613235', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334333735613235', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:37:17 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:17 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:37:17 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 03:37:17 user nova-compute[74836]:   <serial>7c2d17bc-42eb-4754-b22f-513cbd79f661</serial>
Nov 14 03:37:17 user nova-compute[74836]: </disk>
Nov 14 03:37:17 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:37:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] No VIF found with MAC fa:16:3e:9c:fc:93, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf8ad975-d32a-4e2e-8063-d0a1b424d358 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.230s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:18 user nova-compute[74836]: WARNING nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid c6a98f6f-4e96-4b7f-864d-b6ae79521111 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 063425f0-2fc0-4ece-818f-acfd647ee4fb {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: INFO nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:18 user nova-compute[74836]: INFO nova.compute.manager [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Detaching volume 7c2d17bc-42eb-4754-b22f-513cbd79f661
Nov 14 03:37:18 user nova-compute[74836]: INFO nova.virt.block_device [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attempting to driver detach volume 7c2d17bc-42eb-4754-b22f-513cbd79f661 from mountpoint /dev/vdc
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Attempting to detach device vdc from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:18 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:18 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:37:18 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 03:37:18 user nova-compute[74836]:   <serial>7c2d17bc-42eb-4754-b22f-513cbd79f661</serial>
Nov 14 03:37:18 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 03:37:18 user nova-compute[74836]: </disk>
Nov 14 03:37:18 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully detached device vdc from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the persistent domain config.
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:37:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:18 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:18 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:37:18 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 03:37:18 user nova-compute[74836]:   <serial>7c2d17bc-42eb-4754-b22f-513cbd79f661</serial>
Nov 14 03:37:18 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 03:37:18 user nova-compute[74836]: </disk>
Nov 14 03:37:18 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:20 user nova-compute[74836]: INFO nova.compute.manager [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Unrescuing
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:37:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Creating image(s)
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Ensure instance console log exists: /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start _get_guest_xml network_info=[{"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '063425f0-2fc0-4ece-818f-acfd647ee4fb', 'attached_at': '', 'detached_at': '', 'volume_id': '69a5eff9-c4dc-4950-a08f-7629d9c53916', 'serial': '69a5eff9-c4dc-4950-a08f-7629d9c53916'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '55f4cd77-df16-4573-94fc-710fdb93835b', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:37:20 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 03:37:20 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.objects.instance [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lazy-loading 'vcpu_model' on Instance uuid 063425f0-2fc0-4ece-818f-acfd647ee4fb {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:20 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 is timed out.
Nov 14 03:37:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config.
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:20 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:20 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:20 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:37:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yOkSumCr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:20 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd43b4-0b59-4222-9050-e1a24fc34a9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:37:21 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b04d01f-279f-4a62-a567-7fe4edef27e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916] added
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1965f430-531d-4588-9c08-68b6f39ca11b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd0bcc-47b5-444c-b64e-b37aa765531c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWwmNUAj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWwmNUAj" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802fd4b-91c9-43a7-a513-39d420a207c4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWwmNUAj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[84625c18-62c5-4f38-bb49-f14670085137]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3871b3-deb1-4d9c-a0ec-86bfb9a0bab3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG nova.objects.instance [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'flavor' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a5b5cb-421d-4e62-9010-fd01c8f65c40]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]
Nov 14 03:37:21 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b58e297-fff3-4c76-8e53-ec2d1946c6a8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d01f3-b48b-4f58-a1df-04ca252aad12]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] HCTL ('41', '-', '-', 0) found on session 26 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0839d78-ce43-4f14-a69c-2633047f178a]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching for a device in session 26 and hctl ['41', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:21 user nova-compute[74836]: WARNING nova.compute.manager [req-67a24ce0-8cb0-4407-a2d7-031b914ab47b req-abe425e4-49f1-4602-9b10-ea5d3300a12a service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance destroyed successfully.
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Searching for a device in session 26 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23934643066316534', 'path': '/dev/sdj'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934643066316534', 'path': '/dev/sdj'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.418s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4692485-22c8-4742-83d5-cc5673833281]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:37:22 user nova-compute[74836]: No targets found.
Nov 14 03:37:22 user nova-compute[74836]: iSNS:
Nov 14 03:37:22 user nova-compute[74836]: No targets found.
Nov 14 03:37:22 user nova-compute[74836]: STATIC:
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:37:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:22 user nova-compute[74836]: FIRMWARE:
Nov 14 03:37:22 user nova-compute[74836]: No targets found.
Nov 14 03:37:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:37:22 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:37:22 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1441202584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:37:22 user nova-compute[74836]:   <uuid>063425f0-2fc0-4ece-818f-acfd647ee4fb</uuid>
Nov 14 03:37:22 user nova-compute[74836]:   <name>instance-00000013</name>
Nov 14 03:37:22 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:37:22 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:37:22 user nova-compute[74836]:   <metadata>
Nov 14 03:37:22 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:37:22 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:37:22 user nova-compute[74836]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1441202584</nova:name>
Nov 14 03:37:22 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:37:20</nova:creationTime>
Nov 14 03:37:22 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:37:22 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:37:22 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:37:22 user nova-compute[74836]:       <nova:owner>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:user uuid="54b79a4a562a4757bb2395d01893be63">tempest-ServerActionsV293TestJSON-380744936-project-member</nova:user>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:project uuid="b7b5c31cc9284c3aafef858ac0db4678">tempest-ServerActionsV293TestJSON-380744936</nova:project>
Nov 14 03:37:22 user nova-compute[74836]:       </nova:owner>
Nov 14 03:37:22 user nova-compute[74836]:       <nova:ports>
Nov 14 03:37:22 user nova-compute[74836]:         <nova:port uuid="ca953ed5-26d8-4999-b18c-e474e652351e">
Nov 14 03:37:22 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:37:22 user nova-compute[74836]:         </nova:port>
Nov 14 03:37:22 user nova-compute[74836]:       </nova:ports>
Nov 14 03:37:22 user nova-compute[74836]:     </nova:instance>
Nov 14 03:37:22 user nova-compute[74836]:   </metadata>
Nov 14 03:37:22 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:37:22 user nova-compute[74836]:     <system>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="serial">063425f0-2fc0-4ece-818f-acfd647ee4fb</entry>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="uuid">063425f0-2fc0-4ece-818f-acfd647ee4fb</entry>
Nov 14 03:37:22 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:37:22 user nova-compute[74836]:     </system>
Nov 14 03:37:22 user nova-compute[74836]:   </sysinfo>
Nov 14 03:37:22 user nova-compute[74836]:   <os>
Nov 14 03:37:22 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:37:22 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:37:22 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:37:22 user nova-compute[74836]:   </os>
Nov 14 03:37:22 user nova-compute[74836]:   <features>
Nov 14 03:37:22 user nova-compute[74836]:     <acpi/>
Nov 14 03:37:22 user nova-compute[74836]:     <apic/>
Nov 14 03:37:22 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:37:22 user nova-compute[74836]:   </features>
Nov 14 03:37:22 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:37:22 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:37:22 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:37:22 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:37:22 user nova-compute[74836]:   </clock>
Nov 14 03:37:22 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:37:22 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:37:22 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:37:22 user nova-compute[74836]:   </cpu>
Nov 14 03:37:22 user nova-compute[74836]:   <devices>
Nov 14 03:37:22 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:37:22 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:22 user nova-compute[74836]:       <source dev="/dev/sdj"/>
Nov 14 03:37:22 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:37:22 user nova-compute[74836]:       <serial>69a5eff9-c4dc-4950-a08f-7629d9c53916</serial>
Nov 14 03:37:22 user nova-compute[74836]:     </disk>
Nov 14 03:37:22 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:37:22 user nova-compute[74836]:       <mac address="fa:16:3e:6a:c5:e2"/>
Nov 14 03:37:22 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:37:22 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:37:22 user nova-compute[74836]:       <target dev="tapca953ed5-26"/>
Nov 14 03:37:22 user nova-compute[74836]:     </interface>
Nov 14 03:37:22 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:37:22 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb/console.log" append="off"/>
Nov 14 03:37:22 user nova-compute[74836]:     </serial>
Nov 14 03:37:22 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:37:22 user nova-compute[74836]:     <video>
Nov 14 03:37:22 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:37:22 user nova-compute[74836]:     </video>
Nov 14 03:37:22 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:37:22 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:37:22 user nova-compute[74836]:     </rng>
Nov 14 03:37:22 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:37:22 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:37:22 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:37:22 user nova-compute[74836]:     </memballoon>
Nov 14 03:37:22 user nova-compute[74836]:   </devices>
Nov 14 03:37:22 user nova-compute[74836]: </domain>
Nov 14 03:37:22 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1441202584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0422878c-f6df-5a1c-8909-4b396b1ba986', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db8cd10-85a5-44e7-babd-eea8ea22185d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca953ed5-26, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca953ed5-26, col_values=(('qos', UUID('b9531350-562d-45d9-a6da-a576d4a326dc')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca953ed5-26, col_values=(('external_ids', {'iface-id': 'ca953ed5-26d8-4999-b18c-e474e652351e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:c5:e2', 'vm-uuid': '063425f0-2fc0-4ece-818f-acfd647ee4fb'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:22 user nova-compute[74836]: INFO os_vif [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26')
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f12e82-7b4a-4711-84e1-2e5c37731ae3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e45135b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2c42c9-cc5e-48a2-a55a-49c609184f2c]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] No VIF found with MAC fa:16:3e:6a:c5:e2, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[12483763-0581-4d18-b59b-3fb8bbe9785b]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[645318a9-5375-4e80-a89b-6520c20b316d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6f238d-0d69-4cd9-842d-4cf2642b78f5]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e3b39f-1124-4432-ae80-997d9fa6de5c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[99406dd0-a7c9-42d3-be08-d106c4039771]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260]
Nov 14 03:37:22 user nova-compute[74836]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46413db8-7360-43b2-9791-b56c830959b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c4683d-d7f2-4046-ae42-c33b7163db04]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== disconnect_volume: return (1814ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2412adea-1145-4ec8-a94c-8bc0d7f28fb3 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.302s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.304s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:23 user nova-compute[74836]: WARNING nova.compute.manager [req-c8498f81-5015-42c0-a546-6faf7e4140df req-e019e8f0-097c-44d0-b97a-2c6453d2f0fb service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:25 user nova-compute[74836]: WARNING nova.compute.manager [req-02cf8ea7-3e1d-457c-b115-79722923977b req-80c9f391-c27c-4602-a48a-40cdaf0c1bb3 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state active and task_state rebuild_spawning.
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-changed-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Refreshing instance network info cache due to event network-changed-b8cba6e3-3e2c-484c-bb67-732b376f3025. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] Acquiring lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] Acquired lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Refreshing network info cache for port b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updated VIF entry in instance network info cache for port b8cba6e3-3e2c-484c-bb67-732b376f3025. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating instance_info_cache with network_info: [{"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ee1d025f-2bdd-4567-a421-b234f93d2d8a req-799c45ef-c03c-41cd-8d99-35eb9be52b0f service nova] Releasing lock "refresh_cache-5a73b38d-15ff-4132-9fbd-cf82055ca67a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:25 user nova-compute[74836]: WARNING nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:25 user nova-compute[74836]: WARNING nova.compute.manager [req-77a713e0-1b48-4bf4-b029-0fdf69e39b84 req-444c14f8-af05-4250-9960-1dfb930a5bd0 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:26 user nova-compute[74836]: INFO nova.compute.manager [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Unrescuing
Nov 14 03:37:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG nova.objects.instance [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'flavor' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:26 user nova-compute[74836]: DEBUG nova.objects.instance [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lazy-loading 'flavor' on Instance uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:27 user nova-compute[74836]: WARNING nova.compute.manager [req-a15676cd-11fb-468a-9512-1088ed5fa45b req-56cc9159-a1ec-4e3f-b504-6e3a3ec83bdd service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state active and task_state rebuild_spawning.
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:27 user nova-compute[74836]: INFO nova.compute.manager [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Attaching volume 1f8ef401-6a08-473b-a3da-8f03bb4ab1ed to /dev/sdc
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-870eca16-1f95-4d4d-872c-c055b4150c48 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:37:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance spawned successfully.
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.utils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2bd83-c8d2-4eed-a938-f3066f9faf5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance destroyed successfully.
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[54144418-4517-4296-a249-a277b8465e9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b01893e-0d71-459c-ad9f-ca6e634ea2ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac957f87-5552-4151-893d-21320304b784]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:27 user nova-compute[74836]: WARNING nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:27 user nova-compute[74836]: WARNING nova.compute.manager [req-ece0799d-e67b-4bfa-a8a1-7b83414861b5 req-17a79322-e55b-40ab-8ae1-ecc9b1087958 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:27 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34b3bab-096f-438f-890f-4d5032d179d0]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG os_brick.utils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating existing volume attachment record: 1bdbeeca-7257-4360-a249-135e147a044d {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG nova.objects.instance [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74836) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 03:37:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e03b7c98-84d2-4a74-9911-eaa89afcf84a tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.079s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:29 user nova-compute[74836]: WARNING nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:29 user nova-compute[74836]: WARNING nova.compute.manager [req-039d2bef-5878-4a9f-b3bd-534c076cb63b req-23ec922b-ee2e-4508-a3ff-7117ad1cd847 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:37:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-aee61eb3-8fb1-41ea-a018-337cfca99028 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkSrJfNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:32 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7e1708-7903-4430-a7de-b7b11010f7cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:37:32 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f92329a-0219-4e21-b6ae-87807f76a06e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed] added
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fdafc8-2e3f-4e3b-83f4-0b2f4c9f0cb2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f80674-a53a-4922-becb-cf0cbacd71b1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkSrJfNQ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gkSrJfNQ" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f472f4e-62fb-48ad-a5c9-50217f5c2911]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gkSrJfNQ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ab0c22-094f-4f07-a765-cdc90ef1e25a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71f4616-56bd-4223-992b-4452f5c87454]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5b45e0-ebdd-4b2f-a1ca-1beee7e5daa9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260]
Nov 14 03:37:32 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b69593-6fe5-46f0-a3da-7bed0d69fe24]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a682c-9e0f-43b0-991d-e6c3370f43d5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:32 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f887e8-230b-4269-a06e-d1d13130b418]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkSrJfNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:37:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '26662303763663237', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662303763663237', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:37:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lazy-loading 'flavor' on Instance uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:37:33 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:33 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:33 user nova-compute[74836]:   <target dev="sdc" bus="scsi"/>
Nov 14 03:37:33 user nova-compute[74836]:   <serial>1f8ef401-6a08-473b-a3da-8f03bb4ab1ed</serial>
Nov 14 03:37:33 user nova-compute[74836]:   <address type="drive" controller="0" unit="2"/>
Nov 14 03:37:33 user nova-compute[74836]: </disk>
Nov 14 03:37:33 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:37:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No BDM found with device name sda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] No VIF found with MAC fa:16:3e:b7:36:28, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:37:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-431e8aef-e411-4503-9f85-e5ef5e0a1e3f tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.151s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:35 user nova-compute[74836]: INFO nova.compute.manager [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Detaching volume 1f8ef401-6a08-473b-a3da-8f03bb4ab1ed
Nov 14 03:37:35 user nova-compute[74836]: INFO nova.virt.block_device [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Attempting to driver detach volume 1f8ef401-6a08-473b-a3da-8f03bb4ab1ed from mountpoint /dev/sdc
Nov 14 03:37:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Attempting to detach device sdc from instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:35 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:35 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:35 user nova-compute[74836]:   <target dev="sdc" bus="scsi"/>
Nov 14 03:37:35 user nova-compute[74836]:   <serial>1f8ef401-6a08-473b-a3da-8f03bb4ab1ed</serial>
Nov 14 03:37:35 user nova-compute[74836]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 03:37:35 user nova-compute[74836]: </disk>
Nov 14 03:37:35 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Successfully detached device sdc from instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a from the persistent domain config.
Nov 14 03:37:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:37:35 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:35 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:35 user nova-compute[74836]:   <target dev="sdc" bus="scsi"/>
Nov 14 03:37:35 user nova-compute[74836]:   <serial>1f8ef401-6a08-473b-a3da-8f03bb4ab1ed</serial>
Nov 14 03:37:35 user nova-compute[74836]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 03:37:35 user nova-compute[74836]: </disk>
Nov 14 03:37:35 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:37:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc is timed out.
Nov 14 03:37:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully detached device vdc from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the live domain config.
Nov 14 03:37:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'miOzvXVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372b9d3-74bd-4307-bb7a-2b02172774ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:37:39 user nova-compute[74836]: No targets found.
Nov 14 03:37:39 user nova-compute[74836]: iSNS:
Nov 14 03:37:39 user nova-compute[74836]: No targets found.
Nov 14 03:37:39 user nova-compute[74836]: STATIC:
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:37:39 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:39 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:39 user nova-compute[74836]: FIRMWARE:
Nov 14 03:37:39 user nova-compute[74836]: No targets found.
Nov 14 03:37:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:37:39 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:37:39 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90b8d8-061b-4935-b877-0fb2b0411c11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1091a3-2790-46f3-9060-52b6a79da221]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:39 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4455990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6498b6f6-68b4-4493-bcf4-c8cd33ed0f6d]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[57268dda-91d1-4cab-8fdc-b14abf5aa02c]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681827d-eaf9-45e8-8e1c-9d84613e5899]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb56bc7-7e54-451d-9297-523957fe4f37]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19145023-7a4a-4cc2-88b8-7e215375cd32]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e679f-9e76-471c-8570-1ab90c8f4ce7]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260]
Nov 14 03:37:39 user nova-compute[74836]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c2d17bc-42eb-4754-b22f-513cbd79f661 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ced6b2-5d9f-48e0-927b-308956187837]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== disconnect_volume: return (374ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:37:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:40 user nova-compute[74836]: DEBUG nova.objects.instance [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eb19aafd-56f2-4439-ab7a-65352ee763f4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:37:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:49 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdj (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG nova.objects.instance [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:52 user nova-compute[74836]: INFO nova.compute.manager [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attaching volume a9e5dcc8-8e7a-48f1-b292-84bb2513aaba to /dev/vdb
Nov 14 03:37:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.utils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c466571-cc16-465f-9c69-0139b70deb0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[62098f28-bb72-4369-b312-a75034a5df9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4fde39-a7cd-47f6-88da-6a0632c404d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[39042c56-265b-421a-85ed-361b379cf3d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:37:52 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ba46f-8744-47a2-a899-8fbe63bceadb]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG os_brick.utils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating existing volume attachment record: cb3b9633-79dd-4b2b-b6d1-4de3e8ed3815 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:37:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7151MB free_disk=25.147354125976562GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 063425f0-2fc0-4ece-818f-acfd647ee4fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:37:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a is timed out.
Nov 14 03:37:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Successfully detached device sdc from instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a from the live domain config.
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gkSrJfNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:55 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b972da7-35cd-4f10-96b6-d3afeea9db1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:37:55 user nova-compute[74836]: No targets found.
Nov 14 03:37:55 user nova-compute[74836]: iSNS:
Nov 14 03:37:55 user nova-compute[74836]: No targets found.
Nov 14 03:37:55 user nova-compute[74836]: STATIC:
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:37:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:37:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:37:55 user nova-compute[74836]: FIRMWARE:
Nov 14 03:37:55 user nova-compute[74836]: No targets found.
Nov 14 03:37:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:37:55 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:37:55 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880cc1e-0d61-4049-8e0d-b4cce4e2b5a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406dfd9-6137-4538-9ee6-13fb6992964a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:55 user nova-compute[74836]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed (non-flash)
Nov 14 03:37:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44992d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c0018-427e-4a44-8304-89752737008d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:37:55 user nova-compute[74836]: INFO nova.compute.claims [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Claim successful on node user
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63c014-834a-4f90-bcff-88cc8203c347]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d42253e-5d98-4ae7-975c-40c397689bac]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef6da36-949b-402c-9059-b7221c1ec463]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98ece02-97f7-47e4-8263-6ea72b8e3ef6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6e5cfb-f9e0-47f9-aa6b-e976707243ee]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260]
Nov 14 03:37:55 user nova-compute[74836]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f8ef401-6a08-473b-a3da-8f03bb4ab1ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc14818e-1b53-4ec4-8dec-0dc37479a6e4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] <== disconnect_volume: return (393ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:37:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.policy [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7460cb84c194287b1bcbf512bd98ff5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2c60d13f8c14f9a9849ba536a716032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:37:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Creating image(s)
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "/opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "/opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "/opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.objects.instance [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lazy-loading 'flavor' on Instance uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-47638f85-96d7-4188-8e9d-e62307792d5a tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.172s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.virt.images [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] a17330b6-935d-4e02-b055-1d77291d3623 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.part /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RteFXxiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:37:57 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:57 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:37:57 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04b1546-f071-4a42-9139-5aac341f88d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:37:57 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff7dd2-4163-49cb-86f4-e2313808dc0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba] added
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf348dc-22b4-42d5-9ced-871312a6e1f1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6265ac9e-a6bf-475c-b904-02be271a159b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RteFXxiG {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.part /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.converted" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RteFXxiG" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef97b6fe-d883-43a2-afe1-01f3eda50425]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RteFXxiG'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[105b39f8-721f-4d35-8221-6dde1cd44895]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f11aa-8b45-42fb-b090-baa8865b3d2e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[977edf67-3922-4f35-a43f-4953d10d9479]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260]
Nov 14 03:37:57 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260] successful.
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.157s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.079s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[61083139-cc6d-4f69-86b8-22f24ab6e5b7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Successfully created port: 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[66869d3f-4492-4d76-b3c6-050578c04165]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:37:57 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:37:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc733d2-6ecd-4836-9250-7f82ffa053c4]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:57 user nova-compute[74836]: INFO nova.compute.manager [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Terminating instance
Nov 14 03:37:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json" returned: 0 in 0.218s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941,backing_fmt=raw /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941,backing_fmt=raw /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk 1073741824" returned: 0 in 0.057s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "60daa47ba7abbf3591cd9d667ecfeb236ff0d941" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-unplugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] No waiting events found dispatching network-vif-unplugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-f9bcf31e-9277-496d-9ea7-1d1388746051 req-c7113e38-a87e-4e3e-93a1-8231d8202a8d service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-unplugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Cannot resize image /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Ensure instance console log exists: /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Instance destroyed successfully.
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lazy-loading 'resources' on Instance uuid 5a73b38d-15ff-4132-9fbd-cf82055ca67a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1605792734',display_name='tempest-AttachSCSIVolumeTestJSON-server-1605792734',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1605792734',id=21,image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBtwCzTuvtDDXMO9o7tGnUylAaiIJSM3AYB2Cw7v3YZCXW3me9dURyZmwU9ubIyZqQkEY9DJw2Yhd43NNemoxwNjsJG3DVCAEpK/+rD0XxNMlQqb6EvIrchlYALr+bCJg==',key_name='tempest-keypair-1273506546',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9958a22099df444781166f5b1925bdf0',ramdisk_id='',reservation_id='r-nry4hupl',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='56e372cc-ad8c-4a33-a9b0-2beac0ffd89b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1574746081',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1574746081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78158b7b223e442bb4c5e79b60f71f51',uuid=5a73b38d-15ff-4132-9fbd-cf82055ca67a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converting VIF {"id": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "address": "fa:16:3e:b7:36:28", "network": {"id": "2561f0f1-4783-4a71-a548-b78df23548a7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2081190943-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.129", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9958a22099df444781166f5b1925bdf0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8cba6e3-3e", "ovs_interfaceid": "b8cba6e3-3e2c-484c-bb67-732b376f3025", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG os_vif [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8cba6e3-3e, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a999517-66aa-438e-865f-fa1de71dc192) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:37:58 user nova-compute[74836]: INFO os_vif [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:36:28,bridge_name='br-int',has_traffic_filtering=True,id=b8cba6e3-3e2c-484c-bb67-732b376f3025,network=Network(2561f0f1-4783-4a71-a548-b78df23548a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8cba6e3-3e')
Nov 14 03:37:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Deleting instance files /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a_del
Nov 14 03:37:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Deletion of /opt/stack/data/nova/instances/5a73b38d-15ff-4132-9fbd-cf82055ca67a_del complete
Nov 14 03:37:58 user nova-compute[74836]: INFO nova.compute.manager [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 03:37:58 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RteFXxiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '23038303862633934', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038303862633934', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:37:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:37:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:37:58 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:37:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:37:58 user nova-compute[74836]:   <serial>a9e5dcc8-8e7a-48f1-b292-84bb2513aaba</serial>
Nov 14 03:37:58 user nova-compute[74836]: </disk>
Nov 14 03:37:58 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Successfully updated port: 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing instance network info cache due to event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No VIF found with MAC fa:16:3e:90:40:c3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-26b0b79b-5114-49d7-9148-015144f75dde tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.120s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-a1dc5014-28dd-415e-8778-bbd57c0c714b req-4a0bbd03-9c81-457d-b2b9-9a707dbac79e service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-deleted-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:37:59 user nova-compute[74836]: INFO nova.compute.manager [req-a1dc5014-28dd-415e-8778-bbd57c0c714b req-4a0bbd03-9c81-457d-b2b9-9a707dbac79e service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Neutron deleted interface b8cba6e3-3e2c-484c-bb67-732b376f3025; detaching it from the instance and deleting it from the info cache
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-a1dc5014-28dd-415e-8778-bbd57c0c714b req-4a0bbd03-9c81-457d-b2b9-9a707dbac79e service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:37:59 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Took 1.00 seconds to deallocate network for instance.
Nov 14 03:37:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-a1dc5014-28dd-415e-8778-bbd57c0c714b req-4a0bbd03-9c81-457d-b2b9-9a707dbac79e service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Detach interface failed, port_id=b8cba6e3-3e2c-484c-bb67-732b376f3025, reason: Instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:37:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance network_info: |[{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Start _get_guest_xml network_info=[{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:37:53Z,direct_url=<?>,disk_format='qcow2',id=a17330b6-935d-4e02-b055-1d77291d3623,min_disk=0,min_ram=0,name='tempest-scenario-img--605176250',owner='a2c60d13f8c14f9a9849ba536a716032',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:37:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': 'a17330b6-935d-4e02-b055-1d77291d3623'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:38:00 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:00 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:37:53Z,direct_url=<?>,disk_format='qcow2',id=a17330b6-935d-4e02-b055-1d77291d3623,min_disk=0,min_ram=0,name='tempest-scenario-img--605176250',owner='a2c60d13f8c14f9a9849ba536a716032',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:37:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748462573',display_name='tempest-TestMinimumBasicScenario-server-748462573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748462573',id=23,image_ref='a17330b6-935d-4e02-b055-1d77291d3623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9TbnfxFJHNDklojQxUWaCqqp0CGbbNTtyUhkRcy7lbcBRdPT0qaHA7JgRrF94tXdwZSoKM6WBBX5GdJdmVXdyA4NrpIbhDGTWP7sUtrtW2cWIvZ4i3OLfqJ9O0j3shfA==',key_name='tempest-TestMinimumBasicScenario-672904228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-xrmv60zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a17330b6-935d-4e02-b055-1d77291d3623',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:37:57Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=80c90bd7-caaf-4658-962e-058318bc1b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.objects.instance [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'pci_devices' on Instance uuid 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:38:00 user nova-compute[74836]:   <uuid>80c90bd7-caaf-4658-962e-058318bc1b23</uuid>
Nov 14 03:38:00 user nova-compute[74836]:   <name>instance-00000017</name>
Nov 14 03:38:00 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:38:00 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:38:00 user nova-compute[74836]:   <metadata>
Nov 14 03:38:00 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:38:00 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:name>tempest-TestMinimumBasicScenario-server-748462573</nova:name>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:38:00</nova:creationTime>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:38:00 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:38:00 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:owner>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:user uuid="f7460cb84c194287b1bcbf512bd98ff5">tempest-TestMinimumBasicScenario-84832661-project-member</nova:user>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:project uuid="a2c60d13f8c14f9a9849ba536a716032">tempest-TestMinimumBasicScenario-84832661</nova:project>
Nov 14 03:38:00 user nova-compute[74836]:       </nova:owner>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:root type="image" uuid="a17330b6-935d-4e02-b055-1d77291d3623"/>
Nov 14 03:38:00 user nova-compute[74836]:       <nova:ports>
Nov 14 03:38:00 user nova-compute[74836]:         <nova:port uuid="9e139afc-b787-4622-8105-8f76bc27a8a5">
Nov 14 03:38:00 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:38:00 user nova-compute[74836]:         </nova:port>
Nov 14 03:38:00 user nova-compute[74836]:       </nova:ports>
Nov 14 03:38:00 user nova-compute[74836]:     </nova:instance>
Nov 14 03:38:00 user nova-compute[74836]:   </metadata>
Nov 14 03:38:00 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:38:00 user nova-compute[74836]:     <system>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="serial">80c90bd7-caaf-4658-962e-058318bc1b23</entry>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="uuid">80c90bd7-caaf-4658-962e-058318bc1b23</entry>
Nov 14 03:38:00 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:38:00 user nova-compute[74836]:     </system>
Nov 14 03:38:00 user nova-compute[74836]:   </sysinfo>
Nov 14 03:38:00 user nova-compute[74836]:   <os>
Nov 14 03:38:00 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:38:00 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:38:00 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:38:00 user nova-compute[74836]:   </os>
Nov 14 03:38:00 user nova-compute[74836]:   <features>
Nov 14 03:38:00 user nova-compute[74836]:     <acpi/>
Nov 14 03:38:00 user nova-compute[74836]:     <apic/>
Nov 14 03:38:00 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:38:00 user nova-compute[74836]:   </features>
Nov 14 03:38:00 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:38:00 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:38:00 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:38:00 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:38:00 user nova-compute[74836]:   </clock>
Nov 14 03:38:00 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:38:00 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:38:00 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:38:00 user nova-compute[74836]:   </cpu>
Nov 14 03:38:00 user nova-compute[74836]:   <devices>
Nov 14 03:38:00 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:38:00 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:38:00 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk"/>
Nov 14 03:38:00 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:38:00 user nova-compute[74836]:     </disk>
Nov 14 03:38:00 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:38:00 user nova-compute[74836]:       <mac address="fa:16:3e:a4:43:0e"/>
Nov 14 03:38:00 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:38:00 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:38:00 user nova-compute[74836]:       <target dev="tap9e139afc-b7"/>
Nov 14 03:38:00 user nova-compute[74836]:     </interface>
Nov 14 03:38:00 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:38:00 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/console.log" append="off"/>
Nov 14 03:38:00 user nova-compute[74836]:     </serial>
Nov 14 03:38:00 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:38:00 user nova-compute[74836]:     <video>
Nov 14 03:38:00 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:38:00 user nova-compute[74836]:     </video>
Nov 14 03:38:00 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:38:00 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:38:00 user nova-compute[74836]:     </rng>
Nov 14 03:38:00 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:38:00 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:38:00 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:38:00 user nova-compute[74836]:     </memballoon>
Nov 14 03:38:00 user nova-compute[74836]:   </devices>
Nov 14 03:38:00 user nova-compute[74836]: </domain>
Nov 14 03:38:00 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748462573',display_name='tempest-TestMinimumBasicScenario-server-748462573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748462573',id=23,image_ref='a17330b6-935d-4e02-b055-1d77291d3623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9TbnfxFJHNDklojQxUWaCqqp0CGbbNTtyUhkRcy7lbcBRdPT0qaHA7JgRrF94tXdwZSoKM6WBBX5GdJdmVXdyA4NrpIbhDGTWP7sUtrtW2cWIvZ4i3OLfqJ9O0j3shfA==',key_name='tempest-TestMinimumBasicScenario-672904228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-xrmv60zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a17330b6-935d-4e02-b055-1d77291d3623',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:37:57Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=80c90bd7-caaf-4658-962e-058318bc1b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG os_vif [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8428efba-162e-5e26-a82c-50a4534aaf2b', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e139afc-b7, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e139afc-b7, col_values=(('qos', UUID('afd91ad3-c75e-4097-a68b-b49958944f8e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e139afc-b7, col_values=(('external_ids', {'iface-id': '9e139afc-b787-4622-8105-8f76bc27a8a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:43:0e', 'vm-uuid': '80c90bd7-caaf-4658-962e-058318bc1b23'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: INFO os_vif [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7')
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No VIF found with MAC fa:16:3e:a4:43:0e, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] Acquiring lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] No waiting events found dispatching network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:00 user nova-compute[74836]: WARNING nova.compute.manager [req-22d023b7-178a-43a0-8cf6-de147701252d req-e7c9754d-edd9-4b34-950d-25ce887ad14c service nova] [instance: 5a73b38d-15ff-4132-9fbd-cf82055ca67a] Received unexpected event network-vif-plugged-b8cba6e3-3e2c-484c-bb67-732b376f3025 for instance with vm_state deleted and task_state None.
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:00 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Deleted allocations for instance 5a73b38d-15ff-4132-9fbd-cf82055ca67a
Nov 14 03:38:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-806b2b5f-f798-4407-ab6a-f1b24ca851e3 tempest-AttachSCSIVolumeTestJSON-1574746081 tempest-AttachSCSIVolumeTestJSON-1574746081-project-member] Lock "5a73b38d-15ff-4132-9fbd-cf82055ca67a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updated VIF entry in instance network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60eb4d32-464c-4893-b84a-b0d4d633ca5a req-e57a376a-597b-4862-b915-09571919868b service nova] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:01 user nova-compute[74836]: INFO nova.compute.manager [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Detaching volume a9e5dcc8-8e7a-48f1-b292-84bb2513aaba
Nov 14 03:38:01 user nova-compute[74836]: INFO nova.virt.block_device [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attempting to driver detach volume a9e5dcc8-8e7a-48f1-b292-84bb2513aaba from mountpoint /dev/vdb
Nov 14 03:38:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Attempting to detach device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:38:01 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:38:01 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:38:01 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:38:01 user nova-compute[74836]:   <serial>a9e5dcc8-8e7a-48f1-b292-84bb2513aaba</serial>
Nov 14 03:38:01 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:38:01 user nova-compute[74836]: </disk>
Nov 14 03:38:01 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:38:01 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config.
Nov 14 03:38:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:38:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:38:01 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:38:01 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:38:01 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:38:01 user nova-compute[74836]:   <serial>a9e5dcc8-8e7a-48f1-b292-84bb2513aaba</serial>
Nov 14 03:38:01 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:38:01 user nova-compute[74836]: </disk>
Nov 14 03:38:01 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-changed-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing instance network info cache due to event network-changed-d1859093-60a0-4bff-813d-43cabfaf9304. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] Acquiring lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] Acquired lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.network.neutron [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Refreshing network info cache for port d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.network.neutron [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updated VIF entry in instance network info cache for port d1859093-60a0-4bff-813d-43cabfaf9304. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:38:02 user nova-compute[74836]: DEBUG nova.network.neutron [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e4584da2-9132-4048-86d2-75eaa5b03df2 req-e0fd93e0-bdc9-43b3-bfe3-7964e2561659 service nova] Releasing lock "refresh_cache-a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:03 user nova-compute[74836]: INFO nova.compute.manager [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Terminating instance
Nov 14 03:38:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:03 user nova-compute[74836]: WARNING nova.compute.manager [req-a805f692-2122-44d8-80e3-e8340d925dd1 req-20e95124-5dd1-4fbd-a6ec-ea9478941389 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state building and task_state spawning.
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:38:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance spawned successfully.
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:04 user nova-compute[74836]: INFO nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Took 7.77 seconds to spawn the instance on the hypervisor.
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-d1859093-60a0-4bff-813d-43cabfaf9304 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:04 user nova-compute[74836]: WARNING nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-d1859093-60a0-4bff-813d-43cabfaf9304 for instance with vm_state active and task_state deleting.
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-82be23d7-eb26-49c8-840a-5174f579f383 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:04 user nova-compute[74836]: WARNING nova.compute.manager [req-26b27ac6-2bd6-480b-889b-50a80c826928 req-09932516-70d8-4212-b74b-bbd01fef3bb5 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-82be23d7-eb26-49c8-840a-5174f579f383 for instance with vm_state active and task_state deleting.
Nov 14 03:38:04 user nova-compute[74836]: INFO nova.compute.manager [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Took 8.84 seconds to build instance.
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-690d7605-9eb5-4bf2-88d9-6f0bf64d260f tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.968s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Instance destroyed successfully.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lazy-loading 'resources' on Instance uuid a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1859093-60, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b313e384-5a19-478e-babd-2561b06b1514) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:72:f2,bridge_name='br-int',has_traffic_filtering=True,id=d1859093-60a0-4bff-813d-43cabfaf9304,network=Network(77c85c40-34f2-40c8-83bf-04a4886d25f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1859093-60')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4743b0a2-6d, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32eae718-93a1-4ab3-9b41-5e810eac5401) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:6b:ce,bridge_name='br-int',has_traffic_filtering=True,id=4743b0a2-6d81-4b8f-833e-27d5976c7d21,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4743b0a2-6d')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf053bf8-f4, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdb038f0-d744-4ef4-ade6-182695f17485) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:82:d7,bridge_name='br-int',has_traffic_filtering=True,id=af053bf8-f486-4dca-be07-4e47c5faf34b,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapaf053bf8-f4')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82be23d7-eb, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14038489-2f9c-44ae-93c4-0229866eca74) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state active and task_state None.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-4743b0a2-6d81-4b8f-833e-27d5976c7d21 for instance with vm_state active and task_state deleting.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-3d582c9b-44e0-4c71-b74a-2abe31e30287 for instance with vm_state active and task_state deleting.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 for instance with vm_state active and task_state deleting.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING nova.compute.manager [req-e93e55e0-938d-4a08-9bcc-bcbd9a2b636a req-72da8fdd-61cf-4653-8234-8109fe49b378 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-69a7e5be-b7ed-48e5-9f40-f89745f195c6 for instance with vm_state active and task_state deleting.
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:05:97,bridge_name='br-int',has_traffic_filtering=True,id=82be23d7-eb26-49c8-840a-5174f579f383,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82be23d7-eb')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "address": "fa:16:3e:09:87:c4", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.53", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d582c9b-44", "ovs_interfaceid": "3d582c9b-44e0-4c71-b74a-2abe31e30287", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d582c9b-44, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0df12fd-b78e-40e3-8bee-f535bb7f660a) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:87:c4,bridge_name='br-int',has_traffic_filtering=True,id=3d582c9b-44e0-4c71-b74a-2abe31e30287,network=Network(6c5f4f63-c340-4e21-813c-2ba13ced24b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d582c9b-44')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bc42965-d5, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51e8edf8-236f-4428-bb5a-f4a2903817fd) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:a1:05,bridge_name='br-int',has_traffic_filtering=True,id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bc42965-d5')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T03:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1880270170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1880270170',id=22,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLy2qiGvhLhHLcr0rObRpA5mjb6ykuOjucoFiF0A8CReEIDNX3Ji+/mh9uon1PbB2CMitLxZ8T7GcC1uHIxLUON3p8Hx9eO4a2HAWRJTax0hgRQQZC/0kZ9u4FvHqycglQ==',key_name='tempest-keypair-1716067356',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0f68c77b03b49d392e0209cd71a8a15',ramdisk_id='',reservation_id='r-kb30fbz8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2108049424',owner_user_name='tempest-TaggedBootDevicesTest-2108049424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0c1105fdf7f459ba0d6e41e8d1c27d1',uuid=a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converting VIF {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69a7e5be-b7, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7435f2b3-1328-49cd-8117-f176572c5e8b) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:05 user nova-compute[74836]: INFO os_vif [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:55:d8,bridge_name='br-int',has_traffic_filtering=True,id=69a7e5be-b7ed-48e5-9f40-f89745f195c6,network=Network(35b2b3cd-eb9b-4d83-a9ed-fa96e618345a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69a7e5be-b7')
Nov 14 03:38:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xmBwZzYg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:05 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[32559aab-5d9f-48f1-a1c6-b2c78c2ff917]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:05 user nova-compute[74836]: No targets found.
Nov 14 03:38:05 user nova-compute[74836]: iSNS:
Nov 14 03:38:05 user nova-compute[74836]: No targets found.
Nov 14 03:38:05 user nova-compute[74836]: STATIC:
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba
Nov 14 03:38:05 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:05 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:05 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:05 user nova-compute[74836]: No targets found.
Nov 14 03:38:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:05 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:05 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5d258f-8aa5-49cb-ab27-7339809b0447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[050992eb-eff5-45a7-bf4c-a57d54a75f45]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:05 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:05 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43bb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d775701-ed34-4e0d-b52e-45a8da63b70d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d52c5-1080-47ae-94c7-c4a44a3bbd51]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e66695-d23d-4bdd-a3e8-7ac1ca59a5ee]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c0a4d7-90a3-4799-9de4-ac6cca0b105c]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69d51c-ee0a-4fc4-aff8-2f8c84d1d813]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5fa8c2-4e85-4e04-8755-b1717b01fbd2]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260]
Nov 14 03:38:06 user nova-compute[74836]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.compute.claims [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Claim successful on node user
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d753188-889e-42e2-bce6-37726e61c2b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d03e5a-d265-4c88-8423-5f04a15b86df]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== disconnect_volume: return (360ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FSOczMuN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c6839-e978-4540-800b-f7ad55d62c5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]: iSNS:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]: STATIC:
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:06 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:06 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8430e587-28d5-4e5a-a862-0555e083156b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[389edf46-50aa-4ced-b663-e922bf4f45b3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44bf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949'): ({'sdf'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Removing single pathed devices sdf {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2fe12-3746-4883-bce4-a440f2323b15]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[432eee75-5630-4355-9662-24fc5b130a9a]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Flushing IO for device /dev/sdf {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[29474add-5ffe-4d8b-8445-63208f015975]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[534e43a5-4a97-4c46-89fa-17249ca97718]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f8c67a-00cc-4b7a-bca8-96ce6d738e70]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e691ad7-f450-4e73-8d1f-919147d4d4c0]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260]
Nov 14 03:38:06 user nova-compute[74836]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9332009e-2a2e-43ce-a54a-17cf8b9d4949 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3a5dbe-4d20-4b4d-ab9d-fff53802be1a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== disconnect_volume: return (351ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WARnygup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[22af4bde-0905-4db9-8a66-6797f6bde2e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]: iSNS:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]: STATIC:
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba
Nov 14 03:38:06 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:06 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:06 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:06 user nova-compute[74836]: No targets found.
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:06 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:06 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2297e7-cbcb-4688-aeb0-8c6d7deb2d35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5e7efa-91c6-4ec0-9fc7-cd414e20e395]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:06 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44557e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97'): ({'sdg'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Removing single pathed devices sdg {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e9722-e23c-4bd2-b6ce-b2cad4f78de5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e91bc6-ebd1-4121-bcca-145290d47dfd]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Flushing IO for device /dev/sdg {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65ae30c-2bae-407e-9ac4-915f64a385b1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fc229a-2ef4-4950-8de8-772487cd2db7]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.policy [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3983545cf6a4d46858c309b90436dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6087e90cb4f047b089b12a1e35e125ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80e2fd-eb77-4c92-bc00-bd8e22aebd86]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Creating image(s)
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "/opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6259e34a-fdb5-4164-bebe-d59230b9c5cf]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260]
Nov 14 03:38:06 user nova-compute[74836]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d4fe1b9-7978-41c1-b972-c1d4f79b3c97 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cec9e0-afdf-4feb-8c36-3f75cfaebac1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] <== disconnect_volume: return (407ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Deleting instance files /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6_del
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Deletion of /opt/stack/data/nova/instances/a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6_del complete
Nov 14 03:38:06 user nova-compute[74836]: INFO nova.compute.manager [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Took 3.73 seconds to destroy the instance on the hypervisor.
Nov 14 03:38:06 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:38:06 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk 1073741824" returned: 0 in 0.050s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Successfully created port: 577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Cannot resize image /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Ensure instance console log exists: /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-unplugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-29b29231-e21d-40f3-a7a9-126155d49f3c req-9ba7ad2d-a4f0-434e-ae29-97f878ebaafd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-unplugged-af053bf8-f486-4dca-be07-4e47c5faf34b for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Successfully updated port: 577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquired lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updating instance_info_cache with network_info: [{"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Releasing lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Instance network_info: |[{"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Start _get_guest_xml network_info=[{"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:38:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1751577144',display_name='tempest-AttachVolumeNegativeTest-server-1751577144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1751577144',id=24,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+rlEa5uGxEqOIByAbFzq19w0eFekJVqVVvY7zzDv7Hs16TwBQmkOepyJHHPuTrHecqMhfoBHjHmF4MN7b4oqYlHES5om9rnzHhiKDz50+kc9DlgxukPa4BMPzl8wItiA==',key_name='tempest-keypair-393190380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-zjh01f06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=852a825d-62a4-4a54-80a9-f62312bca2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.objects.instance [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'pci_devices' on Instance uuid 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:38:08 user nova-compute[74836]:   <uuid>852a825d-62a4-4a54-80a9-f62312bca2d6</uuid>
Nov 14 03:38:08 user nova-compute[74836]:   <name>instance-00000018</name>
Nov 14 03:38:08 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:38:08 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:38:08 user nova-compute[74836]:   <metadata>
Nov 14 03:38:08 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:38:08 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1751577144</nova:name>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:38:08</nova:creationTime>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:38:08 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:38:08 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:owner>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:user uuid="a3983545cf6a4d46858c309b90436dcd">tempest-AttachVolumeNegativeTest-1016966726-project-member</nova:user>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:project uuid="6087e90cb4f047b089b12a1e35e125ed">tempest-AttachVolumeNegativeTest-1016966726</nova:project>
Nov 14 03:38:08 user nova-compute[74836]:       </nova:owner>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:38:08 user nova-compute[74836]:       <nova:ports>
Nov 14 03:38:08 user nova-compute[74836]:         <nova:port uuid="577288cf-f023-405b-b9a8-157328ce73a5">
Nov 14 03:38:08 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 03:38:08 user nova-compute[74836]:         </nova:port>
Nov 14 03:38:08 user nova-compute[74836]:       </nova:ports>
Nov 14 03:38:08 user nova-compute[74836]:     </nova:instance>
Nov 14 03:38:08 user nova-compute[74836]:   </metadata>
Nov 14 03:38:08 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:38:08 user nova-compute[74836]:     <system>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="serial">852a825d-62a4-4a54-80a9-f62312bca2d6</entry>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="uuid">852a825d-62a4-4a54-80a9-f62312bca2d6</entry>
Nov 14 03:38:08 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:38:08 user nova-compute[74836]:     </system>
Nov 14 03:38:08 user nova-compute[74836]:   </sysinfo>
Nov 14 03:38:08 user nova-compute[74836]:   <os>
Nov 14 03:38:08 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:38:08 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:38:08 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:38:08 user nova-compute[74836]:   </os>
Nov 14 03:38:08 user nova-compute[74836]:   <features>
Nov 14 03:38:08 user nova-compute[74836]:     <acpi/>
Nov 14 03:38:08 user nova-compute[74836]:     <apic/>
Nov 14 03:38:08 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:38:08 user nova-compute[74836]:   </features>
Nov 14 03:38:08 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:38:08 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:38:08 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:38:08 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:38:08 user nova-compute[74836]:   </clock>
Nov 14 03:38:08 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:38:08 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:38:08 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:38:08 user nova-compute[74836]:   </cpu>
Nov 14 03:38:08 user nova-compute[74836]:   <devices>
Nov 14 03:38:08 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:38:08 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:38:08 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk"/>
Nov 14 03:38:08 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:38:08 user nova-compute[74836]:     </disk>
Nov 14 03:38:08 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:38:08 user nova-compute[74836]:       <mac address="fa:16:3e:30:69:86"/>
Nov 14 03:38:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:38:08 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:38:08 user nova-compute[74836]:       <target dev="tap577288cf-f0"/>
Nov 14 03:38:08 user nova-compute[74836]:     </interface>
Nov 14 03:38:08 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:38:08 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/console.log" append="off"/>
Nov 14 03:38:08 user nova-compute[74836]:     </serial>
Nov 14 03:38:08 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:38:08 user nova-compute[74836]:     <video>
Nov 14 03:38:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:38:08 user nova-compute[74836]:     </video>
Nov 14 03:38:08 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:38:08 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:38:08 user nova-compute[74836]:     </rng>
Nov 14 03:38:08 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:38:08 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:38:08 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:38:08 user nova-compute[74836]:     </memballoon>
Nov 14 03:38:08 user nova-compute[74836]:   </devices>
Nov 14 03:38:08 user nova-compute[74836]: </domain>
Nov 14 03:38:08 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1751577144',display_name='tempest-AttachVolumeNegativeTest-server-1751577144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1751577144',id=24,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+rlEa5uGxEqOIByAbFzq19w0eFekJVqVVvY7zzDv7Hs16TwBQmkOepyJHHPuTrHecqMhfoBHjHmF4MN7b4oqYlHES5om9rnzHhiKDz50+kc9DlgxukPa4BMPzl8wItiA==',key_name='tempest-keypair-393190380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-zjh01f06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=852a825d-62a4-4a54-80a9-f62312bca2d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG os_vif [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3622b565-d129-559c-bf04-5100c09dc4e7', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap577288cf-f0, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap577288cf-f0, col_values=(('qos', UUID('92da556a-2c0b-4f9d-89c8-beafe051b244')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap577288cf-f0, col_values=(('external_ids', {'iface-id': '577288cf-f023-405b-b9a8-157328ce73a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:69:86', 'vm-uuid': '852a825d-62a4-4a54-80a9-f62312bca2d6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:08 user nova-compute[74836]: INFO os_vif [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0')
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:38:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:30:69:86, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-9126417a-322b-410e-a7b1-a3d10e45e037 req-b7a18ce3-a095-4479-adc3-0abbd01f0f4c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-deleted-3d582c9b-44e0-4c71-b74a-2abe31e30287 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:09 user nova-compute[74836]: INFO nova.compute.manager [req-9126417a-322b-410e-a7b1-a3d10e45e037 req-b7a18ce3-a095-4479-adc3-0abbd01f0f4c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Neutron deleted interface 3d582c9b-44e0-4c71-b74a-2abe31e30287; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-9126417a-322b-410e-a7b1-a3d10e45e037 req-b7a18ce3-a095-4479-adc3-0abbd01f0f4c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "address": "fa:16:3e:28:55:d8", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69a7e5be-b7", "ovs_interfaceid": "69a7e5be-b7ed-48e5-9f40-f89745f195c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-9126417a-322b-410e-a7b1-a3d10e45e037 req-b7a18ce3-a095-4479-adc3-0abbd01f0f4c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Detach interface failed, port_id=3d582c9b-44e0-4c71-b74a-2abe31e30287, reason: Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:09 user nova-compute[74836]: INFO nova.compute.manager [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Detaching volume 3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:09 user nova-compute[74836]: INFO nova.virt.block_device [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Attempting to driver detach volume 3613fdda-e79b-413a-a52c-410ccb1b1c93 from mountpoint /dev/vdb
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Attempting to detach device vdb from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:38:09 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:38:09 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:38:09 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:38:09 user nova-compute[74836]:   <serial>3613fdda-e79b-413a-a52c-410ccb1b1c93</serial>
Nov 14 03:38:09 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:38:09 user nova-compute[74836]: </disk>
Nov 14 03:38:09 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:38:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully detached device vdb from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the persistent domain config.
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:38:09 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:38:09 user nova-compute[74836]:   <source dev="/dev/sdi"/>
Nov 14 03:38:09 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:38:09 user nova-compute[74836]:   <serial>3613fdda-e79b-413a-a52c-410ccb1b1c93</serial>
Nov 14 03:38:09 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:38:09 user nova-compute[74836]: </disk>
Nov 14 03:38:09 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-changed-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Refreshing instance network info cache due to event network-changed-577288cf-f023-405b-b9a8-157328ce73a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Acquiring lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Acquired lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:38:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Refreshing network info cache for port 577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updated VIF entry in instance network info cache for port 577288cf-f023-405b-b9a8-157328ce73a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updating instance_info_cache with network_info: [{"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Releasing lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Acquiring lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] No waiting events found dispatching network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:10 user nova-compute[74836]: WARNING nova.compute.manager [req-1d5c9a48-7d39-4001-9681-55c8ebde1969 req-74e0e94b-dd2a-4118-9fb4-1ca3bcdddcfd service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received unexpected event network-vif-plugged-af053bf8-f486-4dca-be07-4e47c5faf34b for instance with vm_state active and task_state deleting.
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-deleted-69a7e5be-b7ed-48e5-9f40-f89745f195c6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:11 user nova-compute[74836]: INFO nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Neutron deleted interface 69a7e5be-b7ed-48e5-9f40-f89745f195c6; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "82be23d7-eb26-49c8-840a-5174f579f383", "address": "fa:16:3e:74:05:97", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82be23d7-eb", "ovs_interfaceid": "82be23d7-eb26-49c8-840a-5174f579f383", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Detach interface failed, port_id=69a7e5be-b7ed-48e5-9f40-f89745f195c6, reason: Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-deleted-82be23d7-eb26-49c8-840a-5174f579f383 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:11 user nova-compute[74836]: INFO nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Neutron deleted interface 82be23d7-eb26-49c8-840a-5174f579f383; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "address": "fa:16:3e:18:a1:05", "network": {"id": "35b2b3cd-eb9b-4d83-a9ed-fa96e618345a", "bridge": "br-int", "label": "tempest-device-tagging-net2-236920390", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bc42965-d5", "ovs_interfaceid": "8bc42965-d5bc-4fef-981e-ba718a5d8ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Detach interface failed, port_id=82be23d7-eb26-49c8-840a-5174f579f383, reason: Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-deleted-8bc42965-d5bc-4fef-981e-ba718a5d8ec8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:11 user nova-compute[74836]: INFO nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Neutron deleted interface 8bc42965-d5bc-4fef-981e-ba718a5d8ec8; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "d1859093-60a0-4bff-813d-43cabfaf9304", "address": "fa:16:3e:c0:72:f2", "network": {"id": "77c85c40-34f2-40c8-83bf-04a4886d25f6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-677230646-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1859093-60", "ovs_interfaceid": "d1859093-60a0-4bff-813d-43cabfaf9304", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:11 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Took 4.37 seconds to deallocate network for instance.
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Detach interface failed, port_id=8bc42965-d5bc-4fef-981e-ba718a5d8ec8, reason: Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] No waiting events found dispatching network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received unexpected event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 for instance with vm_state building and task_state spawning.
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] No waiting events found dispatching network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:11 user nova-compute[74836]: WARNING nova.compute.manager [req-d2f730a6-e86a-41c2-8546-414e3adeaa44 req-98c6a009-e2be-4375-81e2-59d8d479218c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received unexpected event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 for instance with vm_state building and task_state spawning.
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:38:12 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Instance spawned successfully.
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:38:12 user nova-compute[74836]: INFO nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 14 03:38:12 user nova-compute[74836]: DEBUG nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:38:12 user nova-compute[74836]: INFO nova.compute.manager [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Took 6.90 seconds to build instance.
Nov 14 03:38:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e76bf62c-04a8-4e30-9e87-cab649aefb36 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.006s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd30cde2-ed41-4259-9e9f-70381a5ce1cb req-dcc6a9af-85d3-451f-9d94-1f3c4cd607b3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Received event network-vif-deleted-d1859093-60a0-4bff-813d-43cabfaf9304 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:13 user nova-compute[74836]: INFO nova.compute.manager [req-fd30cde2-ed41-4259-9e9f-70381a5ce1cb req-dcc6a9af-85d3-451f-9d94-1f3c4cd607b3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Neutron deleted interface d1859093-60a0-4bff-813d-43cabfaf9304; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-fd30cde2-ed41-4259-9e9f-70381a5ce1cb req-dcc6a9af-85d3-451f-9d94-1f3c4cd607b3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Updating instance_info_cache with network_info: [{"id": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "address": "fa:16:3e:84:6b:ce", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4743b0a2-6d", "ovs_interfaceid": "4743b0a2-6d81-4b8f-833e-27d5976c7d21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "af053bf8-f486-4dca-be07-4e47c5faf34b", "address": "fa:16:3e:72:82:d7", "network": {"id": "6c5f4f63-c340-4e21-813c-2ba13ced24b0", "bridge": "br-int", "label": "tempest-device-tagging-net1-538737976", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a0f68c77b03b49d392e0209cd71a8a15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf053bf8-f4", "ovs_interfaceid": "af053bf8-f486-4dca-be07-4e47c5faf34b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-fd30cde2-ed41-4259-9e9f-70381a5ce1cb req-dcc6a9af-85d3-451f-9d94-1f3c4cd607b3 service nova] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Detach interface failed, port_id=d1859093-60a0-4bff-813d-43cabfaf9304, reason: Instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:13 user nova-compute[74836]: INFO nova.compute.manager [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] [instance: a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6] Took 2.30 seconds to detach 3 volumes for instance.
Nov 14 03:38:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:14 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:38:14 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:38:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:14 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Deleted allocations for instance a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6
Nov 14 03:38:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-49d36c4b-dd66-43bb-bb9d-709f2b10a46b tempest-TaggedBootDevicesTest-2108049424 tempest-TaggedBootDevicesTest-2108049424-project-member] Lock "a2ea5a4a-1755-4b1c-9e43-93ee4f7f03d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.047s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:22 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 is timed out.
Nov 14 03:38:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config.
Nov 14 03:38:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RteFXxiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:22 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3fd887-2fad-4c3a-bb6f-875672deb6fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:22 user nova-compute[74836]: No targets found.
Nov 14 03:38:22 user nova-compute[74836]: iSNS:
Nov 14 03:38:22 user nova-compute[74836]: No targets found.
Nov 14 03:38:22 user nova-compute[74836]: STATIC:
Nov 14 03:38:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:22 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba
Nov 14 03:38:22 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:22 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:22 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:22 user nova-compute[74836]: No targets found.
Nov 14 03:38:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:22 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:22 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b2fc1f-3f6b-40ee-b6c0-ad57ca5d5115]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeec3413-75c7-46f2-9960-c07def987200]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:22 user nova-compute[74836]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba (non-flash)
Nov 14 03:38:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d449bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d45cc6-d363-4de9-a8c5-af120b323db0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfea5fc1-b0da-458c-99a7-9cfc36f44ec1]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33c6758-fa23-4ec3-bf50-c4cb5ef23cf7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e240574e-c38b-4b3d-a2a1-ab5a50fbbf70]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9980f515-2c66-4670-8d54-872d8aa6d329]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4f035-6f3d-4e25-949e-8b7b54b4168e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260]
Nov 14 03:38:22 user nova-compute[74836]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:22 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9e5dcc8-8e7a-48f1-b292-84bb2513aaba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0258ac-ac69-41b1-b4be-030e0936e2a0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== disconnect_volume: return (305ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2c022ef4-21c4-458f-8bf0-8bab9be3e36b tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.505s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:30 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc is timed out.
Nov 14 03:38:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully detached device vdb from instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc from the live domain config.
Nov 14 03:38:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WCqYGcTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:30 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69930713-b64e-4f16-8c21-51e041b78254]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:30 user nova-compute[74836]: No targets found.
Nov 14 03:38:30 user nova-compute[74836]: iSNS:
Nov 14 03:38:30 user nova-compute[74836]: No targets found.
Nov 14 03:38:30 user nova-compute[74836]: STATIC:
Nov 14 03:38:30 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93
Nov 14 03:38:30 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:30 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:30 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:30 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:30 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:30 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:30 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:30 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:30 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:30 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:30 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:30 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:30 user nova-compute[74836]: No targets found.
Nov 14 03:38:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:30 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:30 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e91b77d-46ba-42ae-8479-be7c0d232b69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f059f4f-f155-4e85-a572-c5bc1878069f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e45136d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93'): ({'sdi'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Removing single pathed devices sdi {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c301dd86-d313-40e2-9b4f-822c4fa00e36]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4830ba35-2191-43fc-975b-49ea5bf261cf]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Flushing IO for device /dev/sdi {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3ab0f-1618-4276-9a9d-b0f985beb44c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[092ce3da-07d2-4ef2-beaa-01d099899f3d]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] SCSI volumes sdi have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4cf97-27f7-4924-99dd-bcd0c0db7dff]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa2db89-21ea-40c3-a4a2-ca54d12ad77b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260]
Nov 14 03:38:30 user nova-compute[74836]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:30 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3613fdda-e79b-413a-a52c-410ccb1b1c93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b059192d-365b-4387-8f2b-4f09b876b015]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] <== disconnect_volume: return (297ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'flavor' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4fd9cda6-ef27-4174-913a-f1ac43945ed4 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:45 user nova-compute[74836]: INFO nova.compute.manager [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Terminating instance
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-0c948081-25bf-47e8-8cef-1ae5fc3527d1 req-effc065e-f945-4fb0-a6a0-a5400510f0f8 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-unplugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Instance destroyed successfully.
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lazy-loading 'resources' on Instance uuid 063425f0-2fc0-4ece-818f-acfd647ee4fb {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1441202584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-625126260',id=19,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGDScBZ1l5AXOdxklzvVApIj7ZAb/Zemdn90YgsRSScv6sGCEvoSYsQzkbBjXYs3M0+eNKfl5lvYNc6+HII3HojTrMAo/Vg2v7uVBC4kzS00Ce05F0ZSTsqickjif+KqRA==',key_name='tempest-keypair-1862457794',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:37:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7b5c31cc9284c3aafef858ac0db4678',ramdisk_id='',reservation_id='r-bt03ehx5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380744936',owner_user_name='tempest-ServerActionsV293TestJSON-380744936-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='54b79a4a562a4757bb2395d01893be63',uuid=063425f0-2fc0-4ece-818f-acfd647ee4fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converting VIF {"id": "ca953ed5-26d8-4999-b18c-e474e652351e", "address": "fa:16:3e:6a:c5:e2", "network": {"id": "1386a713-0c44-431d-9bfa-c869880128ca", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-239550432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7b5c31cc9284c3aafef858ac0db4678", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca953ed5-26", "ovs_interfaceid": "ca953ed5-26d8-4999-b18c-e474e652351e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_vif [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca953ed5-26, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9531350-562d-45d9-a6da-a576d4a326dc) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:45 user nova-compute[74836]: INFO os_vif [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:c5:e2,bridge_name='br-int',has_traffic_filtering=True,id=ca953ed5-26d8-4999-b18c-e474e652351e,network=Network(1386a713-0c44-431d-9bfa-c869880128ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca953ed5-26')
Nov 14 03:38:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWwmNUAj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[74056997-3a41-4699-9415-df86b065d830]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:38:45 user nova-compute[74836]: No targets found.
Nov 14 03:38:45 user nova-compute[74836]: iSNS:
Nov 14 03:38:45 user nova-compute[74836]: No targets found.
Nov 14 03:38:45 user nova-compute[74836]: STATIC:
Nov 14 03:38:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916
Nov 14 03:38:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:38:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:38:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:38:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:38:45 user nova-compute[74836]: FIRMWARE:
Nov 14 03:38:45 user nova-compute[74836]: No targets found.
Nov 14 03:38:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:38:45 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:38:45 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcc177b-a497-449d-9bb3-9a171d13c051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9274f6ae-c48a-4ebf-ba57-9302c758920a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 (non-flash)
Nov 14 03:38:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d46c7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916'): ({'sdj'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Removing single pathed devices sdj {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f1f90-bed7-45ba-8d4b-1aa28696d55c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d263222-6cae-4c3e-be00-744939c6129e]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Flushing IO for device /dev/sdj {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88f6b7a-0f23-4936-ad66-b3ce7cb78dfb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:38:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba970f0f-6cb6-4f54-b5ed-2a217d1ca2a7]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] SCSI volumes sdj have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8c878091-94d0f1e4c98eb90a', '/dev/disk/by-id/scsi-23934643066316534', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c878091') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c4bc20-a02f-43b8-b8e6-d8b18efa6276]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdc6c29-f409-493d-81d4-f8a7dacc8238]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[315eb5d2-0bb0-43bd-87c8-000c7598766e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260]
Nov 14 03:38:46 user nova-compute[74836]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916, portal: 172.16.0.220,3260] successful.
Nov 14 03:38:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69a5eff9-c4dc-4950-a08f-7629d9c53916 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9fef99-7bdb-4e2f-a609-215441b43759]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] <== disconnect_volume: return (295ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:38:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deleting instance files /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb_del
Nov 14 03:38:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deletion of /opt/stack/data/nova/instances/063425f0-2fc0-4ece-818f-acfd647ee4fb_del complete
Nov 14 03:38:46 user nova-compute[74836]: INFO nova.compute.manager [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 03:38:46 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:46 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Took 0.60 seconds to deallocate network for instance.
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-9480c043-b191-45c5-91af-2d97ca1f557c req-700d8032-e3c7-431e-9ccd-c2bce3b75962 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-deleted-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:46 user nova-compute[74836]: INFO nova.compute.manager [req-9480c043-b191-45c5-91af-2d97ca1f557c req-700d8032-e3c7-431e-9ccd-c2bce3b75962 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Neutron deleted interface ca953ed5-26d8-4999-b18c-e474e652351e; detaching it from the instance and deleting it from the info cache
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-9480c043-b191-45c5-91af-2d97ca1f557c req-700d8032-e3c7-431e-9ccd-c2bce3b75962 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-9480c043-b191-45c5-91af-2d97ca1f557c req-700d8032-e3c7-431e-9ccd-c2bce3b75962 service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Detach interface failed, port_id=ca953ed5-26d8-4999-b18c-e474e652351e, reason: Instance 063425f0-2fc0-4ece-818f-acfd647ee4fb could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] Acquiring lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG nova.compute.manager [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] No waiting events found dispatching network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:38:47 user nova-compute[74836]: WARNING nova.compute.manager [req-24d5ed25-137b-40d2-94f3-8dff94947e5f req-d482e5fe-f1fe-41e7-823e-8e80304a5d5a service nova] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Received unexpected event network-vif-plugged-ca953ed5-26d8-4999-b18c-e474e652351e for instance with vm_state active and task_state deleting.
Nov 14 03:38:47 user nova-compute[74836]: INFO nova.compute.manager [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Took 0.81 seconds to detach 1 volumes for instance.
Nov 14 03:38:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] [instance: 063425f0-2fc0-4ece-818f-acfd647ee4fb] Deleting volume: 69a5eff9-c4dc-4950-a08f-7629d9c53916 {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:48 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Deleted allocations for instance 063425f0-2fc0-4ece-818f-acfd647ee4fb
Nov 14 03:38:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ef1948a7-929c-4163-836b-6c1411ca244c tempest-ServerActionsV293TestJSON-380744936 tempest-ServerActionsV293TestJSON-380744936-project-member] Lock "063425f0-2fc0-4ece-818f-acfd647ee4fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.163s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:50 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:53 user nova-compute[74836]: DEBUG nova.objects.instance [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:54 user nova-compute[74836]: INFO nova.compute.manager [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attaching volume 1c51f0fb-cf5d-4dca-9b8f-e072cca1131d to /dev/vdb
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.utils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c61a13-e54b-4a22-9832-bf430b08df82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f5a22b-fabd-4f66-a206-97cdb47cc364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dd15fc-d8b7-431e-bd1a-c7b9a755885b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218df1c-95d4-493e-984c-4110d02eabfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:38:54 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b4308f-4dc1-418c-89bb-94031a931767]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG os_brick.utils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating existing volume attachment record: 9a280267-03c9-448c-9c2a-2d713a8262f0 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7446MB free_disk=25.125633239746094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c6a98f6f-4e96-4b7f-864d-b6ae79521111 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80c90bd7-caaf-4658-962e-058318bc1b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 852a825d-62a4-4a54-80a9-f62312bca2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:38:55 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:38:56 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:38:56 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:38:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:38:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.543s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:38:59 user nova-compute[74836]: INFO nova.compute.manager [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Terminating instance
Nov 14 03:38:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:38:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-unplugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] No waiting events found dispatching network-vif-unplugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-63e7deff-fa8f-4113-a41b-b2908c89c4c5 req-05fc9d55-5c59-422e-83e3-6671505de888 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-unplugged-b0639cac-1a93-42db-813d-35dd094ab18e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKOsZIoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:00 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:00 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:00 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f66c2-6164-4ac1-a473-637158e1e7d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:39:00 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab65f3f-57fd-4ec8-a005-9e814a0cc8e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d] added
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[853dd678-6268-46d8-9be1-e7ca1e57351e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[466be0e5-ffdf-4258-aa9f-0dfdcb2bca74]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKOsZIoB {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TKOsZIoB" returned: 0 in 0.037s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[367d6e12-43b2-439b-a182-367d45cae75b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TKOsZIoB'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ca6590-507c-4332-92ac-f7fea941333e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1a88e7-7dff-4791-badc-a84b2ebce466]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[61350839-22be-4e21-9eaf-f28c281cc827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260]
Nov 14 03:39:00 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260] successful.
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ac98c4-a16c-4c06-8e41-92b189105fa8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Instance destroyed successfully.
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lazy-loading 'resources' on Instance uuid 6ee0263f-76cc-41e6-bb00-ed8c61d586cc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:35:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1078065673',display_name='tempest-TestServerVolumeAttachmentScenario-server-1078065673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1078065673',id=20,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/AZi1SnXIY2JCl3grz5RG65CPWo3XXJilgY/lhXLzlrE+StTKgSl/BSF5VJbNgU32IS9iHCQYwUTse3aA1EaOwQAmo1gUIkB9qxLRI8o8d+TR8sTcGagvqkEMW4iesOQ==',key_name='tempest-keypair-1197670460',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0284b6a8de1345d19d764a678e52b082',ramdisk_id='',reservation_id='r-nnoyv41x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-162628675',owner_user_name='tempest-TestServerVolumeAttachmentScenario-162628675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e3dfc3bf1754d7a8ab2ad232ae32715',uuid=6ee0263f-76cc-41e6-bb00-ed8c61d586cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converting VIF {"id": "b0639cac-1a93-42db-813d-35dd094ab18e", "address": "fa:16:3e:9c:fc:93", "network": {"id": "7dbdd8dc-efb6-47bb-a282-809836c6fdce", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-582514018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0284b6a8de1345d19d764a678e52b082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0639cac-1a", "ovs_interfaceid": "b0639cac-1a93-42db-813d-35dd094ab18e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_vif [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea8f624-0322-4c60-94d2-bb18ca23802f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:00 user nova-compute[74836]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)
Nov 14 03:39:00 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0639cac-1a, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0077ad7e-b842-417e-b6c7-c6c3bd5f0b6d) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:00 user nova-compute[74836]: INFO os_vif [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:fc:93,bridge_name='br-int',has_traffic_filtering=True,id=b0639cac-1a93-42db-813d-35dd094ab18e,network=Network(7dbdd8dc-efb6-47bb-a282-809836c6fdce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0639cac-1a')
Nov 14 03:39:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Deleting instance files /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc_del
Nov 14 03:39:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Deletion of /opt/stack/data/nova/instances/6ee0263f-76cc-41e6-bb00-ed8c61d586cc_del complete
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5487630-4160-4726-9bd4-a545e4fd0e9c]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:39:00 user nova-compute[74836]: INFO nova.compute.manager [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 03:39:00 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:39:00 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:01 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Took 0.84 seconds to deallocate network for instance.
Nov 14 03:39:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKOsZIoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26365393662616434', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393662616434', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.objects.instance [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:39:01 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:01 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:39:01 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:01 user nova-compute[74836]:   <serial>1c51f0fb-cf5d-4dca-9b8f-e072cca1131d</serial>
Nov 14 03:39:01 user nova-compute[74836]: </disk>
Nov 14 03:39:01 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:02 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Deleted allocations for instance 6ee0263f-76cc-41e6-bb00-ed8c61d586cc
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No VIF found with MAC fa:16:3e:90:40:c3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1948bffd-19c8-4548-a9f7-48b1ec03dbd7 tempest-TestServerVolumeAttachmentScenario-162628675 tempest-TestServerVolumeAttachmentScenario-162628675-project-member] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.353s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] Acquiring lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] Lock "6ee0263f-76cc-41e6-bb00-ed8c61d586cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] No waiting events found dispatching network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:02 user nova-compute[74836]: WARNING nova.compute.manager [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received unexpected event network-vif-plugged-b0639cac-1a93-42db-813d-35dd094ab18e for instance with vm_state deleted and task_state None.
Nov 14 03:39:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f27bbc45-396c-405b-b17b-258dfcb3b965 req-1526bc9c-7b49-4126-81d6-13dd3cc221e1 service nova] [instance: 6ee0263f-76cc-41e6-bb00-ed8c61d586cc] Received event network-vif-deleted-b0639cac-1a93-42db-813d-35dd094ab18e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b180c763-cb7c-4783-8043-f57ce95f7e9c tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:04 user nova-compute[74836]: INFO nova.compute.manager [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Detaching volume 1c51f0fb-cf5d-4dca-9b8f-e072cca1131d
Nov 14 03:39:04 user nova-compute[74836]: INFO nova.virt.block_device [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attempting to driver detach volume 1c51f0fb-cf5d-4dca-9b8f-e072cca1131d from mountpoint /dev/vdb
Nov 14 03:39:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Attempting to detach device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:39:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:39:04 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:04 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:39:04 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:04 user nova-compute[74836]:   <serial>1c51f0fb-cf5d-4dca-9b8f-e072cca1131d</serial>
Nov 14 03:39:04 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:39:04 user nova-compute[74836]: </disk>
Nov 14 03:39:04 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:39:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config.
Nov 14 03:39:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:39:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:39:04 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:04 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:39:04 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:04 user nova-compute[74836]:   <serial>1c51f0fb-cf5d-4dca-9b8f-e072cca1131d</serial>
Nov 14 03:39:04 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:39:04 user nova-compute[74836]: </disk>
Nov 14 03:39:04 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:39:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:39:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:39:07 user nova-compute[74836]: INFO nova.compute.claims [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Claim successful on node user
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:39:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:39:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Creating image(s)
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "/opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "/opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "/opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:07 user nova-compute[74836]: DEBUG nova.policy [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd47901389614f5588bb2af36d1f53e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da7684a63714ab6b3545526f832c6ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk 1073741824" returned: 0 in 0.046s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Successfully created port: 7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Cannot resize image /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Ensure instance console log exists: /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Successfully updated port: 7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquired lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-changed-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Refreshing instance network info cache due to event network-changed-7a852930-aec5-4117-80e5-6f7abbb0da04. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] Acquiring lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updating instance_info_cache with network_info: [{"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Releasing lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Instance network_info: |[{"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] Acquired lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Refreshing network info cache for port 7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Start _get_guest_xml network_info=[{"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:39:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-233209041',display_name='tempest-DeleteServersTestJSON-server-233209041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-233209041',id=25,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4da7684a63714ab6b3545526f832c6ff',ramdisk_id='',reservation_id='r-fgr31hk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-996040629',owner_user_name='tempest-DeleteServersTestJSON-996040629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:08Z,user_data=None,user_id='dd47901389614f5588bb2af36d1f53e2',uuid=6911894d-5ac6-43b9-8322-09dcff470226,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converting VIF {"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lazy-loading 'pci_devices' on Instance uuid 6911894d-5ac6-43b9-8322-09dcff470226 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:39:09 user nova-compute[74836]:   <uuid>6911894d-5ac6-43b9-8322-09dcff470226</uuid>
Nov 14 03:39:09 user nova-compute[74836]:   <name>instance-00000019</name>
Nov 14 03:39:09 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:39:09 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:39:09 user nova-compute[74836]:   <metadata>
Nov 14 03:39:09 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:39:09 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:name>tempest-DeleteServersTestJSON-server-233209041</nova:name>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:39:09</nova:creationTime>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:39:09 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:39:09 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:owner>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:user uuid="dd47901389614f5588bb2af36d1f53e2">tempest-DeleteServersTestJSON-996040629-project-member</nova:user>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:project uuid="4da7684a63714ab6b3545526f832c6ff">tempest-DeleteServersTestJSON-996040629</nova:project>
Nov 14 03:39:09 user nova-compute[74836]:       </nova:owner>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:39:09 user nova-compute[74836]:       <nova:ports>
Nov 14 03:39:09 user nova-compute[74836]:         <nova:port uuid="7a852930-aec5-4117-80e5-6f7abbb0da04">
Nov 14 03:39:09 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 03:39:09 user nova-compute[74836]:         </nova:port>
Nov 14 03:39:09 user nova-compute[74836]:       </nova:ports>
Nov 14 03:39:09 user nova-compute[74836]:     </nova:instance>
Nov 14 03:39:09 user nova-compute[74836]:   </metadata>
Nov 14 03:39:09 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:39:09 user nova-compute[74836]:     <system>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="serial">6911894d-5ac6-43b9-8322-09dcff470226</entry>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="uuid">6911894d-5ac6-43b9-8322-09dcff470226</entry>
Nov 14 03:39:09 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:39:09 user nova-compute[74836]:     </system>
Nov 14 03:39:09 user nova-compute[74836]:   </sysinfo>
Nov 14 03:39:09 user nova-compute[74836]:   <os>
Nov 14 03:39:09 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:39:09 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:39:09 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:39:09 user nova-compute[74836]:   </os>
Nov 14 03:39:09 user nova-compute[74836]:   <features>
Nov 14 03:39:09 user nova-compute[74836]:     <acpi/>
Nov 14 03:39:09 user nova-compute[74836]:     <apic/>
Nov 14 03:39:09 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:39:09 user nova-compute[74836]:   </features>
Nov 14 03:39:09 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:39:09 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:39:09 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:39:09 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:39:09 user nova-compute[74836]:   </clock>
Nov 14 03:39:09 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:39:09 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:39:09 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:39:09 user nova-compute[74836]:   </cpu>
Nov 14 03:39:09 user nova-compute[74836]:   <devices>
Nov 14 03:39:09 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:39:09 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:39:09 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk"/>
Nov 14 03:39:09 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:39:09 user nova-compute[74836]:     </disk>
Nov 14 03:39:09 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:39:09 user nova-compute[74836]:       <mac address="fa:16:3e:e8:69:05"/>
Nov 14 03:39:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:09 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:39:09 user nova-compute[74836]:       <target dev="tap7a852930-ae"/>
Nov 14 03:39:09 user nova-compute[74836]:     </interface>
Nov 14 03:39:09 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:39:09 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/console.log" append="off"/>
Nov 14 03:39:09 user nova-compute[74836]:     </serial>
Nov 14 03:39:09 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:39:09 user nova-compute[74836]:     <video>
Nov 14 03:39:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:09 user nova-compute[74836]:     </video>
Nov 14 03:39:09 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:39:09 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:39:09 user nova-compute[74836]:     </rng>
Nov 14 03:39:09 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:39:09 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:39:09 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:39:09 user nova-compute[74836]:     </memballoon>
Nov 14 03:39:09 user nova-compute[74836]:   </devices>
Nov 14 03:39:09 user nova-compute[74836]: </domain>
Nov 14 03:39:09 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-233209041',display_name='tempest-DeleteServersTestJSON-server-233209041',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-233209041',id=25,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4da7684a63714ab6b3545526f832c6ff',ramdisk_id='',reservation_id='r-fgr31hk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-996040629',owner_user_name='tempest-DeleteServersTestJSON-996040629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:08Z,user_data=None,user_id='dd47901389614f5588bb2af36d1f53e2',uuid=6911894d-5ac6-43b9-8322-09dcff470226,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converting VIF {"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG os_vif [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b25565a-68dd-53ba-9062-fb07beecb745', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a852930-ae, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a852930-ae, col_values=(('qos', UUID('1168fe94-205c-4aba-8aa6-58df7689c007')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a852930-ae, col_values=(('external_ids', {'iface-id': '7a852930-aec5-4117-80e5-6f7abbb0da04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:69:05', 'vm-uuid': '6911894d-5ac6-43b9-8322-09dcff470226'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:09 user nova-compute[74836]: INFO os_vif [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae')
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] No VIF found with MAC fa:16:3e:e8:69:05, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updated VIF entry in instance network info cache for port 7a852930-aec5-4117-80e5-6f7abbb0da04. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updating instance_info_cache with network_info: [{"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6bc78819-a564-4e9d-acd1-92fdd6397090 req-c92f3a98-cc19-42ab-a8f4-6b5d106f419d service nova] Releasing lock "refresh_cache-6911894d-5ac6-43b9-8322-09dcff470226" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] No waiting events found dispatching network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:11 user nova-compute[74836]: WARNING nova.compute.manager [req-e94d1f2e-ebff-4a4a-875a-2d7ab00bf67b req-36575f79-dca4-4cae-855a-5d74db036729 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received unexpected event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 for instance with vm_state building and task_state spawning.
Nov 14 03:39:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:39:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Instance spawned successfully.
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:13 user nova-compute[74836]: INFO nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] No waiting events found dispatching network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:13 user nova-compute[74836]: WARNING nova.compute.manager [req-19ee2d5a-64f0-46d1-a4e5-5b57e9f18503 req-33bf6851-2587-4560-84af-1509ef35c980 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received unexpected event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 for instance with vm_state building and task_state spawning.
Nov 14 03:39:13 user nova-compute[74836]: INFO nova.compute.manager [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Took 6.26 seconds to build instance.
Nov 14 03:39:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a645be63-b735-4956-abea-a85e7f5a7140 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.357s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:15 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:39:15 user nova-compute[74836]: INFO nova.compute.claims [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Claim successful on node user
Nov 14 03:39:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:39:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.policy [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c470afaa49c481cbf37c789908133d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa969498730e4839bbd15d990c31977d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:39:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Creating image(s)
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk 1073741824" returned: 0 in 0.047s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Cannot resize image /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Ensure instance console log exists: /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Successfully created port: 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:39:18 user nova-compute[74836]: INFO nova.compute.claims [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Claim successful on node user
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Successfully updated port: 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing instance network info cache due to event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:39:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:39:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:39:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Creating image(s)
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.policy [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7107bdffb0544dd890311071f04662ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353de76529e464c82aa0d303b797362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance network_info: |[{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start _get_guest_xml network_info=[{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:39:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578475611',display_name='tempest-ServerRescueNegativeTestJSON-server-578475611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578475611',id=26,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+dP51TtQPExAfVDCt6Kg0ib7rMc/PTi/ROlHFD8cNiWvNwwiBtKlwiJavZF+eVqLy160yksGdfM7Iqsg1Mnh/cuteoGQpwBkNKRdzJPJ/k6IIXseo7iTAGQvqGt43Dw==',key_name='tempest-keypair-62033315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-oyp39kbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c470afaa49c481cbf37c789908133d7',uuid=01faa8a1-4b13-4d21-a1e6-01953fe394c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.225s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:39:19 user nova-compute[74836]:   <uuid>01faa8a1-4b13-4d21-a1e6-01953fe394c8</uuid>
Nov 14 03:39:19 user nova-compute[74836]:   <name>instance-0000001a</name>
Nov 14 03:39:19 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:39:19 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:39:19 user nova-compute[74836]:   <metadata>
Nov 14 03:39:19 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:39:19 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578475611</nova:name>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:39:19</nova:creationTime>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:39:19 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:39:19 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:owner>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:39:19 user nova-compute[74836]:       </nova:owner>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:39:19 user nova-compute[74836]:       <nova:ports>
Nov 14 03:39:19 user nova-compute[74836]:         <nova:port uuid="2d882c7e-fe70-4388-b57e-cb89619a2bd6">
Nov 14 03:39:19 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 03:39:19 user nova-compute[74836]:         </nova:port>
Nov 14 03:39:19 user nova-compute[74836]:       </nova:ports>
Nov 14 03:39:19 user nova-compute[74836]:     </nova:instance>
Nov 14 03:39:19 user nova-compute[74836]:   </metadata>
Nov 14 03:39:19 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:39:19 user nova-compute[74836]:     <system>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="serial">01faa8a1-4b13-4d21-a1e6-01953fe394c8</entry>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="uuid">01faa8a1-4b13-4d21-a1e6-01953fe394c8</entry>
Nov 14 03:39:19 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:39:19 user nova-compute[74836]:     </system>
Nov 14 03:39:19 user nova-compute[74836]:   </sysinfo>
Nov 14 03:39:19 user nova-compute[74836]:   <os>
Nov 14 03:39:19 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:39:19 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:39:19 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:39:19 user nova-compute[74836]:   </os>
Nov 14 03:39:19 user nova-compute[74836]:   <features>
Nov 14 03:39:19 user nova-compute[74836]:     <acpi/>
Nov 14 03:39:19 user nova-compute[74836]:     <apic/>
Nov 14 03:39:19 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:39:19 user nova-compute[74836]:   </features>
Nov 14 03:39:19 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:39:19 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:39:19 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:39:19 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:39:19 user nova-compute[74836]:   </clock>
Nov 14 03:39:19 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:39:19 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:39:19 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:39:19 user nova-compute[74836]:   </cpu>
Nov 14 03:39:19 user nova-compute[74836]:   <devices>
Nov 14 03:39:19 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:39:19 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:39:19 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk"/>
Nov 14 03:39:19 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:39:19 user nova-compute[74836]:     </disk>
Nov 14 03:39:19 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:39:19 user nova-compute[74836]:       <mac address="fa:16:3e:44:e0:64"/>
Nov 14 03:39:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:19 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:39:19 user nova-compute[74836]:       <target dev="tap2d882c7e-fe"/>
Nov 14 03:39:19 user nova-compute[74836]:     </interface>
Nov 14 03:39:19 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:39:19 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/console.log" append="off"/>
Nov 14 03:39:19 user nova-compute[74836]:     </serial>
Nov 14 03:39:19 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:39:19 user nova-compute[74836]:     <video>
Nov 14 03:39:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:19 user nova-compute[74836]:     </video>
Nov 14 03:39:19 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:39:19 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:39:19 user nova-compute[74836]:     </rng>
Nov 14 03:39:19 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:39:19 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:39:19 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:39:19 user nova-compute[74836]:     </memballoon>
Nov 14 03:39:19 user nova-compute[74836]:   </devices>
Nov 14 03:39:19 user nova-compute[74836]: </domain>
Nov 14 03:39:19 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578475611',display_name='tempest-ServerRescueNegativeTestJSON-server-578475611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578475611',id=26,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+dP51TtQPExAfVDCt6Kg0ib7rMc/PTi/ROlHFD8cNiWvNwwiBtKlwiJavZF+eVqLy160yksGdfM7Iqsg1Mnh/cuteoGQpwBkNKRdzJPJ/k6IIXseo7iTAGQvqGt43Dw==',key_name='tempest-keypair-62033315',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-oyp39kbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c470afaa49c481cbf37c789908133d7',uuid=01faa8a1-4b13-4d21-a1e6-01953fe394c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG os_vif [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk 1073741824" returned: 0 in 0.071s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c51becfb-9ab8-50d3-aa6b-c7b80fe68595', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d882c7e-fe, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d882c7e-fe, col_values=(('qos', UUID('3050b23f-3b57-4c70-b3d9-19fe8680da70')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d882c7e-fe, col_values=(('external_ids', {'iface-id': '2d882c7e-fe70-4388-b57e-cb89619a2bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:e0:64', 'vm-uuid': '01faa8a1-4b13-4d21-a1e6-01953fe394c8'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:19 user nova-compute[74836]: INFO os_vif [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe')
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:44:e0:64, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Cannot resize image /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:39:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Ensure instance console log exists: /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Successfully created port: 3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updated VIF entry in instance network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0512bf37-5bd6-4c92-ab4e-3fd0f467b2f7 req-172ca66a-86d8-4731-be69-24c5edda2394 service nova] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Successfully updated port: 3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-changed-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Refreshing instance network info cache due to event network-changed-3bf22994-c98b-49dd-ad11-0630cf736de7. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] Acquiring lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:39:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Updating instance_info_cache with network_info: [{"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Instance network_info: |[{"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] Acquired lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Refreshing network info cache for port 3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Start _get_guest_xml network_info=[{"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:39:21 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:21 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343847800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343847800',id=27,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-wms6fmzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:19Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=a7546b77-9e72-491e-85cf-16f76dc01643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.objects.instance [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid a7546b77-9e72-491e-85cf-16f76dc01643 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:39:21 user nova-compute[74836]:   <uuid>a7546b77-9e72-491e-85cf-16f76dc01643</uuid>
Nov 14 03:39:21 user nova-compute[74836]:   <name>instance-0000001b</name>
Nov 14 03:39:21 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:39:21 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:39:21 user nova-compute[74836]:   <metadata>
Nov 14 03:39:21 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:39:21 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1343847800</nova:name>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:39:21</nova:creationTime>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:39:21 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:39:21 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:owner>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:39:21 user nova-compute[74836]:       </nova:owner>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:39:21 user nova-compute[74836]:       <nova:ports>
Nov 14 03:39:21 user nova-compute[74836]:         <nova:port uuid="3bf22994-c98b-49dd-ad11-0630cf736de7">
Nov 14 03:39:21 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:39:21 user nova-compute[74836]:         </nova:port>
Nov 14 03:39:21 user nova-compute[74836]:       </nova:ports>
Nov 14 03:39:21 user nova-compute[74836]:     </nova:instance>
Nov 14 03:39:21 user nova-compute[74836]:   </metadata>
Nov 14 03:39:21 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:39:21 user nova-compute[74836]:     <system>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="serial">a7546b77-9e72-491e-85cf-16f76dc01643</entry>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="uuid">a7546b77-9e72-491e-85cf-16f76dc01643</entry>
Nov 14 03:39:21 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:39:21 user nova-compute[74836]:     </system>
Nov 14 03:39:21 user nova-compute[74836]:   </sysinfo>
Nov 14 03:39:21 user nova-compute[74836]:   <os>
Nov 14 03:39:21 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:39:21 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:39:21 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:39:21 user nova-compute[74836]:   </os>
Nov 14 03:39:21 user nova-compute[74836]:   <features>
Nov 14 03:39:21 user nova-compute[74836]:     <acpi/>
Nov 14 03:39:21 user nova-compute[74836]:     <apic/>
Nov 14 03:39:21 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:39:21 user nova-compute[74836]:   </features>
Nov 14 03:39:21 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:39:21 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:39:21 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:39:21 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:39:21 user nova-compute[74836]:   </clock>
Nov 14 03:39:21 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:39:21 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:39:21 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:39:21 user nova-compute[74836]:   </cpu>
Nov 14 03:39:21 user nova-compute[74836]:   <devices>
Nov 14 03:39:21 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:39:21 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:39:21 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk"/>
Nov 14 03:39:21 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:39:21 user nova-compute[74836]:     </disk>
Nov 14 03:39:21 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:39:21 user nova-compute[74836]:       <mac address="fa:16:3e:c5:38:9d"/>
Nov 14 03:39:21 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:21 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:39:21 user nova-compute[74836]:       <target dev="tap3bf22994-c9"/>
Nov 14 03:39:21 user nova-compute[74836]:     </interface>
Nov 14 03:39:21 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:39:21 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/console.log" append="off"/>
Nov 14 03:39:21 user nova-compute[74836]:     </serial>
Nov 14 03:39:21 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:39:21 user nova-compute[74836]:     <video>
Nov 14 03:39:21 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:21 user nova-compute[74836]:     </video>
Nov 14 03:39:21 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:39:21 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:39:21 user nova-compute[74836]:     </rng>
Nov 14 03:39:21 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:39:21 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:39:21 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:39:21 user nova-compute[74836]:     </memballoon>
Nov 14 03:39:21 user nova-compute[74836]:   </devices>
Nov 14 03:39:21 user nova-compute[74836]: </domain>
Nov 14 03:39:21 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343847800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343847800',id=27,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-wms6fmzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:19Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=a7546b77-9e72-491e-85cf-16f76dc01643,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG os_vif [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7602da57-a7ed-5758-a7d5-609f91e8ac11', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3bf22994-c9, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3bf22994-c9, col_values=(('qos', UUID('f8d1de20-95ec-4b95-9095-bb153f7cb9a6')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3bf22994-c9, col_values=(('external_ids', {'iface-id': '3bf22994-c98b-49dd-ad11-0630cf736de7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:38:9d', 'vm-uuid': 'a7546b77-9e72-491e-85cf-16f76dc01643'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: INFO os_vif [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9')
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:c5:38:9d, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Updated VIF entry in instance network info cache for port 3bf22994-c98b-49dd-ad11-0630cf736de7. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Updating instance_info_cache with network_info: [{"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e96950d5-f78b-4270-b37c-658a710aca04 req-3eae1477-3f4f-4961-9704-728538cc151a service nova] Releasing lock "refresh_cache-a7546b77-9e72-491e-85cf-16f76dc01643" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG nova.compute.manager [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:22 user nova-compute[74836]: WARNING nova.compute.manager [req-11951309-220b-46c7-bc4e-194c17093daf req-97bd40d5-d739-4578-81d7-4ca1e48ebd96 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state building and task_state spawning.
Nov 14 03:39:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:24 user nova-compute[74836]: WARNING nova.compute.manager [req-0a767534-2b22-4a2e-b551-09fbfdc09ece req-5fb81e7e-aa88-48cb-9db4-2fcf1315417c service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state building and task_state spawning.
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:39:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance spawned successfully.
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:39:24 user nova-compute[74836]: INFO nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Took 8.42 seconds to spawn the instance on the hypervisor.
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:39:24 user nova-compute[74836]: INFO nova.compute.claims [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Claim successful on node user
Nov 14 03:39:24 user nova-compute[74836]: INFO nova.compute.manager [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Took 9.42 seconds to build instance.
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee9981e5-1a0e-4f8a-bfd3-eaaa14acb9ce tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.518s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:24 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 is timed out.
Nov 14 03:39:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config.
Nov 14 03:39:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TKOsZIoB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:24 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd52a310-934e-4704-84e2-05e4493352c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:39:24 user nova-compute[74836]: No targets found.
Nov 14 03:39:24 user nova-compute[74836]: iSNS:
Nov 14 03:39:24 user nova-compute[74836]: No targets found.
Nov 14 03:39:24 user nova-compute[74836]: STATIC:
Nov 14 03:39:24 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d
Nov 14 03:39:24 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:24 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:24 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:39:24 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:24 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:24 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:39:24 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:24 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:24 user nova-compute[74836]: FIRMWARE:
Nov 14 03:39:24 user nova-compute[74836]: No targets found.
Nov 14 03:39:24 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:39:24 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:39:24 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:39:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea6666-fbf4-4b68-bee1-ddc66f0c2d4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c00620-d6d3-4c4c-9645-354727f36443]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:25 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:25 user nova-compute[74836]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)
Nov 14 03:39:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:25 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:25 user nova-compute[74836]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d (non-flash)
Nov 14 03:39:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4226dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d044ca6c-ee9b-4456-9622-707fd85f19f8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcadc4-ca69-461d-8a07-1c62223fbe99]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf4463-d35d-4a40-9fa9-fe8fad5ea36d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d4c770-4cb8-496e-95ab-a39a402cd07a]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[926dea73-1c22-4a77-a260-e7fbfb56f736]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Instance spawned successfully.
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c95306-a06e-456d-b12e-ef53560435bf]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260]
Nov 14 03:39:25 user nova-compute[74836]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d, portal: 172.16.0.220,3260] successful.
Nov 14 03:39:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c51f0fb-cf5d-4dca-9b8f-e072cca1131d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cd8000-1755-406e-8827-6c4cf708a501]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== disconnect_volume: return (357ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:39:25 user nova-compute[74836]: INFO nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.633s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:39:25 user nova-compute[74836]: INFO nova.compute.manager [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Took 7.18 seconds to build instance.
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-b605d770-7a85-4afb-9d70-2b4155f583a6 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.301s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:39:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.policy [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77ede53dd4ff404fbf5575c29105308b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a8a057308442f981535f38628faa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:39:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Creating image(s)
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.217s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk 1073741824" returned: 0 in 0.056s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d46639eb-d839-41f5-b64b-8ea6d9603495 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.959s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Successfully created port: 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.210s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Cannot resize image /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Ensure instance console log exists: /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Successfully updated port: 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing instance network info cache due to event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance network_info: |[{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start _get_guest_xml network_info=[{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:39:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt4lSXlVx0s1RrjRFU10g22o0ubqBwvFva9WW+DhqwgdeYy4Sb/6B6Mm39Fosth8aOToFc2q7CoT/CCDrkQQzfA+8+O9a7L3fELu7kMYdQVlCcxJ4f26hU9sQ5Xx2tQ1A==',key_name='tempest-keypair-200914316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.objects.instance [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_devices' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:39:27 user nova-compute[74836]:   <uuid>3199c66c-37e1-4ce9-af73-4c9c00fb3634</uuid>
Nov 14 03:39:27 user nova-compute[74836]:   <name>instance-0000001c</name>
Nov 14 03:39:27 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:39:27 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:39:27 user nova-compute[74836]:   <metadata>
Nov 14 03:39:27 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:39:27 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-654954825</nova:name>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:39:27</nova:creationTime>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:39:27 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:39:27 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:owner>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:user uuid="77ede53dd4ff404fbf5575c29105308b">tempest-AttachVolumeShelveTestJSON-267361624-project-member</nova:user>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:project uuid="42a8a057308442f981535f38628faa53">tempest-AttachVolumeShelveTestJSON-267361624</nova:project>
Nov 14 03:39:27 user nova-compute[74836]:       </nova:owner>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:39:27 user nova-compute[74836]:       <nova:ports>
Nov 14 03:39:27 user nova-compute[74836]:         <nova:port uuid="7f596b10-ed9f-4904-9fde-62f789fd56dd">
Nov 14 03:39:27 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:39:27 user nova-compute[74836]:         </nova:port>
Nov 14 03:39:27 user nova-compute[74836]:       </nova:ports>
Nov 14 03:39:27 user nova-compute[74836]:     </nova:instance>
Nov 14 03:39:27 user nova-compute[74836]:   </metadata>
Nov 14 03:39:27 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:39:27 user nova-compute[74836]:     <system>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="serial">3199c66c-37e1-4ce9-af73-4c9c00fb3634</entry>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="uuid">3199c66c-37e1-4ce9-af73-4c9c00fb3634</entry>
Nov 14 03:39:27 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:39:27 user nova-compute[74836]:     </system>
Nov 14 03:39:27 user nova-compute[74836]:   </sysinfo>
Nov 14 03:39:27 user nova-compute[74836]:   <os>
Nov 14 03:39:27 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:39:27 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:39:27 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:39:27 user nova-compute[74836]:   </os>
Nov 14 03:39:27 user nova-compute[74836]:   <features>
Nov 14 03:39:27 user nova-compute[74836]:     <acpi/>
Nov 14 03:39:27 user nova-compute[74836]:     <apic/>
Nov 14 03:39:27 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:39:27 user nova-compute[74836]:   </features>
Nov 14 03:39:27 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:39:27 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:39:27 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:39:27 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:39:27 user nova-compute[74836]:   </clock>
Nov 14 03:39:27 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:39:27 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:39:27 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:39:27 user nova-compute[74836]:   </cpu>
Nov 14 03:39:27 user nova-compute[74836]:   <devices>
Nov 14 03:39:27 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:39:27 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:39:27 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk"/>
Nov 14 03:39:27 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:39:27 user nova-compute[74836]:     </disk>
Nov 14 03:39:27 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:39:27 user nova-compute[74836]:       <mac address="fa:16:3e:3e:16:8c"/>
Nov 14 03:39:27 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:27 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:39:27 user nova-compute[74836]:       <target dev="tap7f596b10-ed"/>
Nov 14 03:39:27 user nova-compute[74836]:     </interface>
Nov 14 03:39:27 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:39:27 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/console.log" append="off"/>
Nov 14 03:39:27 user nova-compute[74836]:     </serial>
Nov 14 03:39:27 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:39:27 user nova-compute[74836]:     <video>
Nov 14 03:39:27 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:27 user nova-compute[74836]:     </video>
Nov 14 03:39:27 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:39:27 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:39:27 user nova-compute[74836]:     </rng>
Nov 14 03:39:27 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:39:27 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:39:27 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:39:27 user nova-compute[74836]:     </memballoon>
Nov 14 03:39:27 user nova-compute[74836]:   </devices>
Nov 14 03:39:27 user nova-compute[74836]: </domain>
Nov 14 03:39:27 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt4lSXlVx0s1RrjRFU10g22o0ubqBwvFva9WW+DhqwgdeYy4Sb/6B6Mm39Fosth8aOToFc2q7CoT/CCDrkQQzfA+8+O9a7L3fELu7kMYdQVlCcxJ4f26hU9sQ5Xx2tQ1A==',key_name='tempest-keypair-200914316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG os_vif [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3606f147-4af3-5ca6-bdab-e199837bc378', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f596b10-ed, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f596b10-ed, col_values=(('qos', UUID('33c68539-c82c-4152-8e93-7145da53efe2')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f596b10-ed, col_values=(('external_ids', {'iface-id': '7f596b10-ed9f-4904-9fde-62f789fd56dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:16:8c', 'vm-uuid': '3199c66c-37e1-4ce9-af73-4c9c00fb3634'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:27 user nova-compute[74836]: INFO os_vif [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed')
Nov 14 03:39:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No VIF found with MAC fa:16:3e:3e:16:8c, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG nova.network.neutron [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updated VIF entry in instance network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG nova.network.neutron [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6910eb36-13b8-4203-8793-8d3e03d106e6 req-a3d03543-a662-42e6-843d-003e05028caf service nova] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:28 user nova-compute[74836]: INFO nova.compute.manager [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Terminating instance
Nov 14 03:39:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:39:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-f83d13d9-482b-4e22-9cfe-087ed33fc1cb req-26cfe8ef-dbfa-46ab-962a-3ca8203cda37 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] No waiting events found dispatching network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:29 user nova-compute[74836]: WARNING nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received unexpected event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 for instance with vm_state active and task_state None.
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] No waiting events found dispatching network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:29 user nova-compute[74836]: WARNING nova.compute.manager [req-96e43423-2ab1-49a5-8ca8-95847b659c53 req-c775da7e-a3e7-4605-b1a6-72ed06eb2c8f service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received unexpected event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 for instance with vm_state active and task_state None.
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:29 user nova-compute[74836]: WARNING nova.compute.manager [req-4916101b-b007-4aa3-9e64-6bb9994fb3ce req-115e47ee-54c6-4a2d-977a-913ff77cd5e5 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state building and task_state spawning.
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Instance destroyed successfully.
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.objects.instance [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lazy-loading 'resources' on Instance uuid c6a98f6f-4e96-4b7f-864d-b6ae79521111 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-752949228',display_name='tempest-ServersNegativeTestJSON-server-752949228',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-752949228',id=4,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='300a5c30444b4f93be44cc7580991dc4',ramdisk_id='',reservation_id='r-za7d0j7m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1971360444',owner_user_name='tempest-ServersNegativeTestJSON-1971360444-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:02Z,user_data=None,user_id='ab86e22169934541aaf5599c215eb601',uuid=c6a98f6f-4e96-4b7f-864d-b6ae79521111,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converting VIF {"id": "8f783eb0-4e54-46ee-a885-3041d40d6417", "address": "fa:16:3e:e4:fc:fb", "network": {"id": "2b4cab5d-ca0c-4a0c-af6e-e5421270654f", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2008590879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "300a5c30444b4f93be44cc7580991dc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f783eb0-4e", "ovs_interfaceid": "8f783eb0-4e54-46ee-a885-3041d40d6417", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG os_vif [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f783eb0-4e, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96930af7-e207-4473-95c7-abab3feb6ffe) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:30 user nova-compute[74836]: INFO os_vif [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:fc:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f783eb0-4e54-46ee-a885-3041d40d6417,network=Network(2b4cab5d-ca0c-4a0c-af6e-e5421270654f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f783eb0-4e')
Nov 14 03:39:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Deleting instance files /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111_del
Nov 14 03:39:30 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Deletion of /opt/stack/data/nova/instances/c6a98f6f-4e96-4b7f-864d-b6ae79521111_del complete
Nov 14 03:39:30 user nova-compute[74836]: INFO nova.compute.manager [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 14 03:39:30 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:30 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Took 0.50 seconds to deallocate network for instance.
Nov 14 03:39:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state deleted and task_state None.
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state deleted and task_state None.
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state deleted and task_state None.
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-unplugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state deleted and task_state None.
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Acquiring lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] No waiting events found dispatching network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c47c0e-273f-4d61-8299-5d73d418b300 req-465bd1ea-889a-48cf-8150-bc7c69fa67c1 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received unexpected event network-vif-plugged-8f783eb0-4e54-46ee-a885-3041d40d6417 for instance with vm_state deleted and task_state None.
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-c57e3ae0-8140-4157-9f06-e02de49d95b8 req-da9fe18a-c6c5-4e1c-b333-39cbf40f4f41 service nova] [instance: c6a98f6f-4e96-4b7f-864d-b6ae79521111] Received event network-vif-deleted-8f783eb0-4e54-46ee-a885-3041d40d6417 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Deleted allocations for instance c6a98f6f-4e96-4b7f-864d-b6ae79521111
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fbe43988-b04c-4ee4-8c55-07f29032df2f tempest-ServersNegativeTestJSON-1971360444 tempest-ServersNegativeTestJSON-1971360444-project-member] Lock "c6a98f6f-4e96-4b7f-864d-b6ae79521111" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.657s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:31 user nova-compute[74836]: WARNING nova.compute.manager [req-e3c5c5d2-fde3-4dbc-aaa6-83bef5ad099d req-a4da74ab-9871-4259-8b1d-e20f3c7a9820 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state building and task_state spawning.
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:39:32 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance spawned successfully.
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:32 user nova-compute[74836]: INFO nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Took 6.58 seconds to spawn the instance on the hypervisor.
Nov 14 03:39:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:39:32 user nova-compute[74836]: INFO nova.compute.manager [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Took 7.63 seconds to build instance.
Nov 14 03:39:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-107dcb73-83ad-4b6b-8aeb-d055af76f548 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.759s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:34 user nova-compute[74836]: INFO nova.compute.manager [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Detaching volume 8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:39:34 user nova-compute[74836]: INFO nova.virt.block_device [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Attempting to driver detach volume 8500e651-7975-4b9a-8797-74d00c4952c1 from mountpoint /dev/vdb
Nov 14 03:39:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Attempting to detach device vdb from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:39:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:39:34 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:34 user nova-compute[74836]:   <source dev="/dev/sdh"/>
Nov 14 03:39:34 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:34 user nova-compute[74836]:   <serial>8500e651-7975-4b9a-8797-74d00c4952c1</serial>
Nov 14 03:39:34 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:39:34 user nova-compute[74836]: </disk>
Nov 14 03:39:34 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:39:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully detached device vdb from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the persistent domain config.
Nov 14 03:39:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:39:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:39:34 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:34 user nova-compute[74836]:   <source dev="/dev/sdh"/>
Nov 14 03:39:34 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:34 user nova-compute[74836]:   <serial>8500e651-7975-4b9a-8797-74d00c4952c1</serial>
Nov 14 03:39:34 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:39:34 user nova-compute[74836]: </disk>
Nov 14 03:39:34 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:39:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:39:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:48 user nova-compute[74836]: INFO nova.compute.manager [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Attaching volume 86cef820-0edd-4f34-a4ed-964c66102b85 to /dev/vdb
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.utils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8df0d9-61d5-403c-ab4d-96cd29073076]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdb2406-db66-4c9f-a379-0d5de2636ace]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1719d960-9ed6-4f32-a4fd-67e3cce71037]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[165de8c1-41c1-4dc9-abd4-3fd96959e59a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:48 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe097947-9c12-45f0-8ae2-ba3928279f4b]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG os_brick.utils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating existing volume attachment record: a512a244-6468-475d-9b6e-2c0c8763bc2a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:39:50 user nova-compute[74836]: INFO nova.compute.claims [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Claim successful on node user
Nov 14 03:39:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:39:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:39:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.policy [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16e5d6e474e54299a2cbe8094a46d896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd43e6daeb32480a83a53334ddf46567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:39:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Creating image(s)
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk 1073741824" returned: 0 in 0.062s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Successfully created port: a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Cannot resize image /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Ensure instance console log exists: /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:51 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Successfully updated port: a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing instance network info cache due to event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance network_info: |[{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start _get_guest_xml network_info=[{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:39:52 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:52 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-95912381',display_name='tempest-ServerStableDeviceRescueTest-server-95912381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-95912381',id=29,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUulbrK4M6ry0RgtySgnTgsd/I8t2nBB2ZXRuZgTHZyaTBj1FI9b2srpNwrPgxGnLmCgmWANqcDoONraM6yJ3nyCggdfbNUYCw9DFdm3b9ZCMD/uvUqUp+mEAd4lk4xZw==',key_name='tempest-keypair-982684915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd43e6daeb32480a83a53334ddf46567',ramdisk_id='',reservation_id='r-lfr817sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-996871557',owner_user_name='tempest-ServerStableDeviceRescueTest-996871557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16e5d6e474e54299a2cbe8094a46d896',uuid=8c388b9c-02bb-4831-9978-9101b4050288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converting VIF {"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:39:52 user nova-compute[74836]:   <uuid>8c388b9c-02bb-4831-9978-9101b4050288</uuid>
Nov 14 03:39:52 user nova-compute[74836]:   <name>instance-0000001d</name>
Nov 14 03:39:52 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:39:52 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:39:52 user nova-compute[74836]:   <metadata>
Nov 14 03:39:52 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:39:52 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-95912381</nova:name>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:39:52</nova:creationTime>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:39:52 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:39:52 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:owner>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:user uuid="16e5d6e474e54299a2cbe8094a46d896">tempest-ServerStableDeviceRescueTest-996871557-project-member</nova:user>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:project uuid="bd43e6daeb32480a83a53334ddf46567">tempest-ServerStableDeviceRescueTest-996871557</nova:project>
Nov 14 03:39:52 user nova-compute[74836]:       </nova:owner>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:39:52 user nova-compute[74836]:       <nova:ports>
Nov 14 03:39:52 user nova-compute[74836]:         <nova:port uuid="a4f70871-618b-47a0-a1a3-cba1cd7e806a">
Nov 14 03:39:52 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:39:52 user nova-compute[74836]:         </nova:port>
Nov 14 03:39:52 user nova-compute[74836]:       </nova:ports>
Nov 14 03:39:52 user nova-compute[74836]:     </nova:instance>
Nov 14 03:39:52 user nova-compute[74836]:   </metadata>
Nov 14 03:39:52 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:39:52 user nova-compute[74836]:     <system>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="serial">8c388b9c-02bb-4831-9978-9101b4050288</entry>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="uuid">8c388b9c-02bb-4831-9978-9101b4050288</entry>
Nov 14 03:39:52 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:39:52 user nova-compute[74836]:     </system>
Nov 14 03:39:52 user nova-compute[74836]:   </sysinfo>
Nov 14 03:39:52 user nova-compute[74836]:   <os>
Nov 14 03:39:52 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:39:52 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:39:52 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:39:52 user nova-compute[74836]:   </os>
Nov 14 03:39:52 user nova-compute[74836]:   <features>
Nov 14 03:39:52 user nova-compute[74836]:     <acpi/>
Nov 14 03:39:52 user nova-compute[74836]:     <apic/>
Nov 14 03:39:52 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:39:52 user nova-compute[74836]:   </features>
Nov 14 03:39:52 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:39:52 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:39:52 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:39:52 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:39:52 user nova-compute[74836]:   </clock>
Nov 14 03:39:52 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:39:52 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:39:52 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:39:52 user nova-compute[74836]:   </cpu>
Nov 14 03:39:52 user nova-compute[74836]:   <devices>
Nov 14 03:39:52 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:39:52 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:39:52 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk"/>
Nov 14 03:39:52 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:39:52 user nova-compute[74836]:     </disk>
Nov 14 03:39:52 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:39:52 user nova-compute[74836]:       <mac address="fa:16:3e:07:fb:b9"/>
Nov 14 03:39:52 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:52 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:39:52 user nova-compute[74836]:       <target dev="tapa4f70871-61"/>
Nov 14 03:39:52 user nova-compute[74836]:     </interface>
Nov 14 03:39:52 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:39:52 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/console.log" append="off"/>
Nov 14 03:39:52 user nova-compute[74836]:     </serial>
Nov 14 03:39:52 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:39:52 user nova-compute[74836]:     <video>
Nov 14 03:39:52 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:39:52 user nova-compute[74836]:     </video>
Nov 14 03:39:52 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:39:52 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:39:52 user nova-compute[74836]:     </rng>
Nov 14 03:39:52 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:39:52 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:39:52 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:39:52 user nova-compute[74836]:     </memballoon>
Nov 14 03:39:52 user nova-compute[74836]:   </devices>
Nov 14 03:39:52 user nova-compute[74836]: </domain>
Nov 14 03:39:52 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-95912381',display_name='tempest-ServerStableDeviceRescueTest-server-95912381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-95912381',id=29,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUulbrK4M6ry0RgtySgnTgsd/I8t2nBB2ZXRuZgTHZyaTBj1FI9b2srpNwrPgxGnLmCgmWANqcDoONraM6yJ3nyCggdfbNUYCw9DFdm3b9ZCMD/uvUqUp+mEAd4lk4xZw==',key_name='tempest-keypair-982684915',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd43e6daeb32480a83a53334ddf46567',ramdisk_id='',reservation_id='r-lfr817sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-996871557',owner_user_name='tempest-ServerStableDeviceRescueTest-996871557-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16e5d6e474e54299a2cbe8094a46d896',uuid=8c388b9c-02bb-4831-9978-9101b4050288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converting VIF {"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG os_vif [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e93995f-6acf-53d1-8429-73ff2a69c9aa', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4f70871-61, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4f70871-61, col_values=(('qos', UUID('189cacb9-5284-4195-b320-2efd7859dac9')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4f70871-61, col_values=(('external_ids', {'iface-id': 'a4f70871-618b-47a0-a1a3-cba1cd7e806a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:fb:b9', 'vm-uuid': '8c388b9c-02bb-4831-9978-9101b4050288'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:52 user nova-compute[74836]: INFO os_vif [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61')
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No VIF found with MAC fa:16:3e:07:fb:b9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updated VIF entry in instance network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d0c523a-e2e1-4c9f-994f-68a385d71808 req-5ab0eb53-11a5-4723-b4db-03b4286fdaf6 service nova] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwDTzrqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:53 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:53 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:53 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[124b0250-0869-499f-bea6-0a686209c878]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:39:53 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8878f4a2-e5eb-4775-b025-4a016daa3544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85] added
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85957608-4cb5-43fa-9847-3dfec84767f8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[844a98cf-2e9a-4123-a8a8-6742ebeaccf9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwDTzrqg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwDTzrqg" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c8dbe-8344-435a-810e-4c7c7afa297e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AwDTzrqg'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870df98-d973-4176-ba8a-352a1fe83322]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd42d1c-5f39-4697-8b80-6581bd2434b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef689604-8261-4583-89cb-92da541c464d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260]
Nov 14 03:39:53 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260] successful.
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd7199f-ed0d-4d10-95a7-f51165da8f1f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcbefd6-1340-48fd-ad1a-f9fd08d4013e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:39:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ee313c-66e7-4161-a485-356567efc8b9]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwDTzrqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:54 user nova-compute[74836]: WARNING nova.compute.manager [req-f68b407d-e06b-47b0-9d13-e1bf5d448dbb req-f7343dc2-e00c-43f1-8dca-c5dd6897be26 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state building and task_state spawning.
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26630626664653938', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630626664653938', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:39:54 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:39:54 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:39:54 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:39:54 user nova-compute[74836]:   <serial>86cef820-0edd-4f34-a4ed-964c66102b85</serial>
Nov 14 03:39:54 user nova-compute[74836]: </disk>
Nov 14 03:39:54 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c340e46d-8444-46be-a47f-13e9b91698a4 is timed out.
Nov 14 03:39:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully detached device vdb from instance c340e46d-8444-46be-a47f-13e9b91698a4 from the live domain config.
Nov 14 03:39:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpMzVEqx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:55 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[582f251b-def3-4f59-b9e1-1976a7c500a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:39:55 user nova-compute[74836]: No targets found.
Nov 14 03:39:55 user nova-compute[74836]: iSNS:
Nov 14 03:39:55 user nova-compute[74836]: No targets found.
Nov 14 03:39:55 user nova-compute[74836]: STATIC:
Nov 14 03:39:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85
Nov 14 03:39:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:39:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:55 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1
Nov 14 03:39:55 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:39:55 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:39:55 user nova-compute[74836]: FIRMWARE:
Nov 14 03:39:55 user nova-compute[74836]: No targets found.
Nov 14 03:39:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:39:55 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:39:55 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfd7429-b902-4cc1-aa93-6ac1b1cd823d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7bff4a-d8ca-445b-94be-7afb8e514036]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:39:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d43e5240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1'): ({'sdh'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Removing single pathed devices sdh {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[031750ca-3a1a-4b54-b25c-45e81cfe28ef]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3218a25c-a9d7-41e8-8e80-1a9de7741597]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flushing IO for device /dev/sdh {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d288af-c0cf-4351-8c5d-6061cbfd5726]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.080s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf213220-ccd4-4bc2-98da-cff75c4d1744]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] SCSI volumes sdh have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] No VIF found with MAC fa:16:3e:a4:43:0e, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f2a08f-0309-4449-a90f-29d6506f8352]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e49e0-eaeb-4f59-82b6-0312c92ed3d7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260]
Nov 14 03:39:55 user nova-compute[74836]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1, portal: 172.16.0.220,3260] successful.
Nov 14 03:39:55 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8500e651-7975-4b9a-8797-74d00c4952c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb300d7-3b18-43fa-9625-264b3ccf9d30]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== disconnect_volume: return (451ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3ecf4c0d-13a5-469f-9df4-c8e24372cb37 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.951s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.objects.instance [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'flavor' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-56293fe9-a497-4700-951a-858a80f54776 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.086s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:39:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance spawned successfully.
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:39:56 user nova-compute[74836]: WARNING nova.compute.manager [req-78feb12b-d7c0-426a-bc04-d500db0903f9 req-5ae5f79c-21d3-4071-a073-0d43c9a6a29c service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state building and task_state spawning.
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:56 user nova-compute[74836]: INFO nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:39:56 user nova-compute[74836]: INFO nova.compute.manager [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Took 6.39 seconds to build instance.
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7b7cc87d-c63e-49e6-b105-12ca2cecbb6c tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.491s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:57 user nova-compute[74836]: INFO nova.compute.manager [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attaching volume a4edb777-9920-46e8-9901-5006319e73bc to /dev/vdb
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.utils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaad851-5d6c-4bfb-bf65-fcc04c16bfda]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44164ee-74d9-43bd-9672-bcc113fdf514]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ce14c-7ecb-4ec1-a967-0510f672a704]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061ffac-091f-4976-8f7e-ae91af0244b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:57 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f126a9d-8e1c-4bc9-a750-269a446c767c]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG os_brick.utils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating existing volume attachment record: e2f53bbe-0c71-40ca-b836-cb0d512e3d06 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:57 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:57 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:39:57 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7007MB free_disk=25.04662322998047GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c340e46d-8444-46be-a47f-13e9b91698a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80c90bd7-caaf-4658-962e-058318bc1b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 852a825d-62a4-4a54-80a9-f62312bca2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6911894d-5ac6-43b9-8322-09dcff470226 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-changed-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Refreshing instance network info cache due to event network-changed-577288cf-f023-405b-b9a8-157328ce73a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] Acquiring lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] Acquired lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Refreshing network info cache for port 577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing instance network info cache due to event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:39:59 user nova-compute[74836]: INFO nova.compute.manager [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Attaching volume 2a268a6e-24d5-44a6-bbd0-021419fc510a to /dev/vdb
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef72750a-f4dd-4d38-8f53-82679c48b69c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b46f28-9180-4e79-8537-439484be2b78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c11b8c-04b6-410a-8c2a-51f63132b457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424d627-ff7a-4b6b-8a5b-bba6547dd3b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updated VIF entry in instance network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:39:59 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a939eb1f-fbe6-4970-8453-c52d3db0edbb]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updating existing volume attachment record: 732475b7-1032-4509-b696-9ff15ae9b589 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfa8dcd3-d2d8-4589-8943-cfd2615a3346 req-4b4cebd9-4d22-48de-b4bf-c4088604583f service nova] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updated VIF entry in instance network info cache for port 577288cf-f023-405b-b9a8-157328ce73a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updating instance_info_cache with network_info: [{"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82c4e5f4-4493-4439-98cd-25562de60221 req-77faf1ac-8f75-4792-8255-5adc8ada8447 service nova] Releasing lock "refresh_cache-852a825d-62a4-4a54-80a9-f62312bca2d6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:39:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing instance network info cache due to event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:40:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoZYetpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:40:02 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:40:02 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:40:02 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a5b117-0c37-4d8b-9c79-712bd8c95dd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:40:02 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fadeabb-a1cc-43dc-b37f-3bf2490d6ca0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc] added
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG nova.network.neutron [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updated VIF entry in instance network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG nova.network.neutron [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[676c521a-9c32-4e71-8b18-fafdfe513b33]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ba44830-a4fe-49a8-9f78-abf3c2e5adb3 req-17089462-5116-43de-99b8-b011d84c7052 service nova] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f60347-1131-4c10-9622-7d56f3b38785]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoZYetpa {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QoZYetpa" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[db087280-000c-4312-93e4-5894a880b936]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QoZYetpa'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[828bee68-de3e-4c25-bf55-78323c29d656]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8d33b4-51aa-4e31-aec7-9a589ba8bfc5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:02 user nova-compute[74836]: INFO nova.compute.manager [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Rebooting instance
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae1be5-d803-4479-ad89-29e0333121f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260]
Nov 14 03:40:02 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260] successful.
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f4f440-e88d-4fe3-8ca6-74833bfd1474]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19140d2f-3271-4f55-a793-a0684bf4536e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:02 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:02 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG nova.network.neutron [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[916c8e66-3885-4d7f-8ca4-a4088ba794b1]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoZYetpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:40:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23937313736636332', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937313736636332', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:40:03 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:40:03 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:40:03 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:40:03 user nova-compute[74836]:   <serial>a4edb777-9920-46e8-9901-5006319e73bc</serial>
Nov 14 03:40:03 user nova-compute[74836]: </disk>
Nov 14 03:40:03 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] No VIF found with MAC fa:16:3e:90:40:c3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLetponh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:40:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:40:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:40:04 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a4e59-f690-456d-addf-156320d68dad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:40:04 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0465891-0a0b-423a-8f2c-6259d7088913]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a] added
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[35808ec2-32fc-47b1-9b9d-21af726e4250]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bf094553-24e2-4dea-8ad7-68911eb4729d tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.236s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3f552d-4e36-4db9-b741-72ec5fdd42d4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLetponh {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vLetponh" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dece9be-6668-4ce4-904e-a4a77a778e3e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vLetponh'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f4a9a0-c695-42d5-bf4a-068553e5432e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[82576def-5f68-49a8-9c99-a9cf2e8e9657]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be4adff-18f9-4bee-a89c-7b13984d653f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260]
Nov 14 03:40:04 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260] successful.
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac9855-8ccd-401d-bc99-be45e14bc82b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec5b9e0-d8e3-49b6-89a3-36b1a80cfb02]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:40:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[628be151-6973-406c-ae38-96cd530a1d89]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:40:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLetponh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23566623562386139', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566623562386139', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:40:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:40:05 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:40:05 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:40:05 user nova-compute[74836]:   <serial>2a268a6e-24d5-44a6-bbd0-021419fc510a</serial>
Nov 14 03:40:05 user nova-compute[74836]: </disk>
Nov 14 03:40:05 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:05 user nova-compute[74836]: WARNING nova.compute.manager [req-aad49c29-970f-4e4c-babf-0dc2c69bd76b req-5d5b3a86-9fc9-4289-8363-68141c99c9e7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state active and task_state reboot_started.
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:30:69:86, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8f35d480-d083-4f6c-a90d-a5039a79f923 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.856s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance shutdown successfully.
Nov 14 03:40:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:06 user nova-compute[74836]: INFO nova.compute.manager [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Detaching volume a4edb777-9920-46e8-9901-5006319e73bc
Nov 14 03:40:06 user nova-compute[74836]: INFO nova.virt.block_device [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Attempting to driver detach volume a4edb777-9920-46e8-9901-5006319e73bc from mountpoint /dev/vdb
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Attempting to detach device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:40:06 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:40:06 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:40:06 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:40:06 user nova-compute[74836]:   <serial>a4edb777-9920-46e8-9901-5006319e73bc</serial>
Nov 14 03:40:06 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:40:06 user nova-compute[74836]: </disk>
Nov 14 03:40:06 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:40:06 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the persistent domain config.
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:40:06 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:40:06 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:40:06 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:40:06 user nova-compute[74836]:   <serial>a4edb777-9920-46e8-9901-5006319e73bc</serial>
Nov 14 03:40:06 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:40:06 user nova-compute[74836]: </disk>
Nov 14 03:40:06 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:40:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:40:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:07 user nova-compute[74836]: WARNING nova.compute.manager [req-684f4160-4f02-4750-a3e6-912d7364106b req-31aeec02-1c7a-4e3b-8f0f-9f0447f6d111 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state active and task_state reboot_started.
Nov 14 03:40:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance running successfully.
Nov 14 03:40:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance soft rebooted successfully.
Nov 14 03:40:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-71dcdf7a-d0a0-4138-b750-7ae1d99512f6 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.837s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:40:10 user nova-compute[74836]: INFO nova.compute.claims [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Claim successful on node user
Nov 14 03:40:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:10 user nova-compute[74836]: WARNING nova.compute.manager [req-900d4850-8734-4fb0-b57f-13d3364aa4b5 req-0fbfa982-dc72-4d15-ac61-6fefd6be9b14 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state active and task_state None.
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:40:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.policy [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3983545cf6a4d46858c309b90436dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6087e90cb4f047b089b12a1e35e125ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:40:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Creating image(s)
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "/opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk 1073741824" returned: 0 in 0.076s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Successfully created port: bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Cannot resize image /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Ensure instance console log exists: /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Successfully updated port: bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquired lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:12 user nova-compute[74836]: WARNING nova.compute.manager [req-4b9bf24b-88e4-4ca1-82fc-25f5e0443afa req-ea98bdee-8c3c-4424-ad1b-99505ff03880 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state active and task_state None.
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-changed-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Refreshing instance network info cache due to event network-changed-bc71d157-317b-4b86-b48e-86a248845b89. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] Acquiring lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updating instance_info_cache with network_info: [{"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Releasing lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Instance network_info: |[{"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] Acquired lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Refreshing network info cache for port bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Start _get_guest_xml network_info=[{"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:40:13 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:13 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-680413040',display_name='tempest-AttachVolumeNegativeTest-server-680413040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-680413040',id=30,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM7Fbee6sypIzlAc9U8WUena0e3/gyFjpKyhobv4FhnWv/jgtBCrM9hkkRWGMBCTUV02nzmgt9gt+F093xocoTUb84uhPCpsE5iPjRAInCuGvcUcnUdjmpZc5ZKaHgLPA==',key_name='tempest-keypair-493137995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-2jjkpgjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=df849240-5277-48ec-aac7-cbe35ee857b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.objects.instance [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'pci_devices' on Instance uuid df849240-5277-48ec-aac7-cbe35ee857b6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:40:13 user nova-compute[74836]:   <uuid>df849240-5277-48ec-aac7-cbe35ee857b6</uuid>
Nov 14 03:40:13 user nova-compute[74836]:   <name>instance-0000001e</name>
Nov 14 03:40:13 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:40:13 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:40:13 user nova-compute[74836]:   <metadata>
Nov 14 03:40:13 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:40:13 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeNegativeTest-server-680413040</nova:name>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:40:13</nova:creationTime>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:40:13 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:40:13 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:owner>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:user uuid="a3983545cf6a4d46858c309b90436dcd">tempest-AttachVolumeNegativeTest-1016966726-project-member</nova:user>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:project uuid="6087e90cb4f047b089b12a1e35e125ed">tempest-AttachVolumeNegativeTest-1016966726</nova:project>
Nov 14 03:40:13 user nova-compute[74836]:       </nova:owner>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:40:13 user nova-compute[74836]:       <nova:ports>
Nov 14 03:40:13 user nova-compute[74836]:         <nova:port uuid="bc71d157-317b-4b86-b48e-86a248845b89">
Nov 14 03:40:13 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:40:13 user nova-compute[74836]:         </nova:port>
Nov 14 03:40:13 user nova-compute[74836]:       </nova:ports>
Nov 14 03:40:13 user nova-compute[74836]:     </nova:instance>
Nov 14 03:40:13 user nova-compute[74836]:   </metadata>
Nov 14 03:40:13 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:40:13 user nova-compute[74836]:     <system>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="serial">df849240-5277-48ec-aac7-cbe35ee857b6</entry>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="uuid">df849240-5277-48ec-aac7-cbe35ee857b6</entry>
Nov 14 03:40:13 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:40:13 user nova-compute[74836]:     </system>
Nov 14 03:40:13 user nova-compute[74836]:   </sysinfo>
Nov 14 03:40:13 user nova-compute[74836]:   <os>
Nov 14 03:40:13 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:40:13 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:40:13 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:40:13 user nova-compute[74836]:   </os>
Nov 14 03:40:13 user nova-compute[74836]:   <features>
Nov 14 03:40:13 user nova-compute[74836]:     <acpi/>
Nov 14 03:40:13 user nova-compute[74836]:     <apic/>
Nov 14 03:40:13 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:40:13 user nova-compute[74836]:   </features>
Nov 14 03:40:13 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:40:13 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:40:13 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:40:13 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:40:13 user nova-compute[74836]:   </clock>
Nov 14 03:40:13 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:40:13 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:40:13 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:40:13 user nova-compute[74836]:   </cpu>
Nov 14 03:40:13 user nova-compute[74836]:   <devices>
Nov 14 03:40:13 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:40:13 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:40:13 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk"/>
Nov 14 03:40:13 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:40:13 user nova-compute[74836]:     </disk>
Nov 14 03:40:13 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:40:13 user nova-compute[74836]:       <mac address="fa:16:3e:d6:ba:35"/>
Nov 14 03:40:13 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:13 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:40:13 user nova-compute[74836]:       <target dev="tapbc71d157-31"/>
Nov 14 03:40:13 user nova-compute[74836]:     </interface>
Nov 14 03:40:13 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:40:13 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/console.log" append="off"/>
Nov 14 03:40:13 user nova-compute[74836]:     </serial>
Nov 14 03:40:13 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:40:13 user nova-compute[74836]:     <video>
Nov 14 03:40:13 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:13 user nova-compute[74836]:     </video>
Nov 14 03:40:13 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:40:13 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:40:13 user nova-compute[74836]:     </rng>
Nov 14 03:40:13 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:40:13 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:40:13 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:40:13 user nova-compute[74836]:     </memballoon>
Nov 14 03:40:13 user nova-compute[74836]:   </devices>
Nov 14 03:40:13 user nova-compute[74836]: </domain>
Nov 14 03:40:13 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-680413040',display_name='tempest-AttachVolumeNegativeTest-server-680413040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-680413040',id=30,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM7Fbee6sypIzlAc9U8WUena0e3/gyFjpKyhobv4FhnWv/jgtBCrM9hkkRWGMBCTUV02nzmgt9gt+F093xocoTUb84uhPCpsE5iPjRAInCuGvcUcnUdjmpZc5ZKaHgLPA==',key_name='tempest-keypair-493137995',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-2jjkpgjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=df849240-5277-48ec-aac7-cbe35ee857b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG os_vif [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b7ee62a-1c31-51e2-a11c-1799866bc590', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc71d157-31, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc71d157-31, col_values=(('qos', UUID('ccce49c7-b550-46f4-a879-48bc93cfe467')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc71d157-31, col_values=(('external_ids', {'iface-id': 'bc71d157-317b-4b86-b48e-86a248845b89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:ba:35', 'vm-uuid': 'df849240-5277-48ec-aac7-cbe35ee857b6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:13 user nova-compute[74836]: INFO os_vif [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31')
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:d6:ba:35, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updated VIF entry in instance network info cache for port bc71d157-317b-4b86-b48e-86a248845b89. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updating instance_info_cache with network_info: [{"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1336c2d-edf2-4478-86d5-368b82f83363 req-d4b6e97b-a31f-495d-971d-466c62ce3389 service nova] Releasing lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:40:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Instance spawned successfully.
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] No waiting events found dispatching network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:17 user nova-compute[74836]: WARNING nova.compute.manager [req-3efa7ee2-9baa-445e-906c-a5b91d3dc02d req-9994c415-cf66-4760-805c-8798d7352ed6 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received unexpected event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 for instance with vm_state building and task_state spawning.
Nov 14 03:40:17 user nova-compute[74836]: INFO nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Took 5.83 seconds to spawn the instance on the hypervisor.
Nov 14 03:40:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:40:17 user nova-compute[74836]: INFO nova.compute.manager [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Took 6.99 seconds to build instance.
Nov 14 03:40:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-14554c91-5192-4e2a-a47b-72f7abc3c04e tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.119s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] No waiting events found dispatching network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:19 user nova-compute[74836]: WARNING nova.compute.manager [req-c92927e9-a97f-4893-abd5-4d25a726b9a5 req-ea42d82a-a464-4c0b-903a-d30a0666d796 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received unexpected event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 for instance with vm_state active and task_state None.
Nov 14 03:40:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:40:21 user nova-compute[74836]: INFO nova.compute.claims [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Claim successful on node user
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.219s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:40:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:40:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Creating image(s)
Nov 14 03:40:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "/opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "/opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:22 user nova-compute[74836]: DEBUG nova.policy [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5afea1b58e4115957a8435f15ec95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e650c0a29644dcbbb797a589e94729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk 1073741824" returned: 0 in 0.066s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Cannot resize image /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Ensure instance console log exists: /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Successfully created port: 2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Successfully updated port: 2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquired lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing instance network info cache due to event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] Acquiring lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:24 user nova-compute[74836]: INFO nova.compute.manager [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Terminating instance
Nov 14 03:40:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-609ad48a-e57f-457e-830f-3edb5dc3de11 req-a31cbc89-0270-46bd-9ced-1e24ad854d30 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-unplugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Releasing lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Instance network_info: |[{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] Acquired lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Start _get_guest_xml network_info=[{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:40:25 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:25 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1888566944',display_name='tempest-TestStampPattern-server-1888566944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1888566944',id=31,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-ls992yss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:23Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.objects.instance [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'pci_devices' on Instance uuid a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:40:25 user nova-compute[74836]:   <uuid>a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99</uuid>
Nov 14 03:40:25 user nova-compute[74836]:   <name>instance-0000001f</name>
Nov 14 03:40:25 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:40:25 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:40:25 user nova-compute[74836]:   <metadata>
Nov 14 03:40:25 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:40:25 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:name>tempest-TestStampPattern-server-1888566944</nova:name>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:40:25</nova:creationTime>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:40:25 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:40:25 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:owner>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:user uuid="ed5afea1b58e4115957a8435f15ec95f">tempest-TestStampPattern-6640805-project-member</nova:user>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:project uuid="66e650c0a29644dcbbb797a589e94729">tempest-TestStampPattern-6640805</nova:project>
Nov 14 03:40:25 user nova-compute[74836]:       </nova:owner>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:40:25 user nova-compute[74836]:       <nova:ports>
Nov 14 03:40:25 user nova-compute[74836]:         <nova:port uuid="2008fbaf-1507-4dc2-9a75-d6f707b960fc">
Nov 14 03:40:25 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 03:40:25 user nova-compute[74836]:         </nova:port>
Nov 14 03:40:25 user nova-compute[74836]:       </nova:ports>
Nov 14 03:40:25 user nova-compute[74836]:     </nova:instance>
Nov 14 03:40:25 user nova-compute[74836]:   </metadata>
Nov 14 03:40:25 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:40:25 user nova-compute[74836]:     <system>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="serial">a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99</entry>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="uuid">a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99</entry>
Nov 14 03:40:25 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:40:25 user nova-compute[74836]:     </system>
Nov 14 03:40:25 user nova-compute[74836]:   </sysinfo>
Nov 14 03:40:25 user nova-compute[74836]:   <os>
Nov 14 03:40:25 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:40:25 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:40:25 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:40:25 user nova-compute[74836]:   </os>
Nov 14 03:40:25 user nova-compute[74836]:   <features>
Nov 14 03:40:25 user nova-compute[74836]:     <acpi/>
Nov 14 03:40:25 user nova-compute[74836]:     <apic/>
Nov 14 03:40:25 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:40:25 user nova-compute[74836]:   </features>
Nov 14 03:40:25 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:40:25 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:40:25 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:40:25 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:40:25 user nova-compute[74836]:   </clock>
Nov 14 03:40:25 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:40:25 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:40:25 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:40:25 user nova-compute[74836]:   </cpu>
Nov 14 03:40:25 user nova-compute[74836]:   <devices>
Nov 14 03:40:25 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:40:25 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:40:25 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk"/>
Nov 14 03:40:25 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:40:25 user nova-compute[74836]:     </disk>
Nov 14 03:40:25 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:40:25 user nova-compute[74836]:       <mac address="fa:16:3e:3b:64:04"/>
Nov 14 03:40:25 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:25 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:40:25 user nova-compute[74836]:       <target dev="tap2008fbaf-15"/>
Nov 14 03:40:25 user nova-compute[74836]:     </interface>
Nov 14 03:40:25 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:40:25 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/console.log" append="off"/>
Nov 14 03:40:25 user nova-compute[74836]:     </serial>
Nov 14 03:40:25 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:40:25 user nova-compute[74836]:     <video>
Nov 14 03:40:25 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:25 user nova-compute[74836]:     </video>
Nov 14 03:40:25 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:40:25 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:40:25 user nova-compute[74836]:     </rng>
Nov 14 03:40:25 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:40:25 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:40:25 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:40:25 user nova-compute[74836]:     </memballoon>
Nov 14 03:40:25 user nova-compute[74836]:   </devices>
Nov 14 03:40:25 user nova-compute[74836]: </domain>
Nov 14 03:40:25 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1888566944',display_name='tempest-TestStampPattern-server-1888566944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1888566944',id=31,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-ls992yss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:23Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG os_vif [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6076f827-574e-574a-bb28-56c9c525ae10', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2008fbaf-15, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2008fbaf-15, col_values=(('qos', UUID('bc90c74d-963d-4fe8-8ad3-b6626a95b6a8')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2008fbaf-15, col_values=(('external_ids', {'iface-id': '2008fbaf-1507-4dc2-9a75-d6f707b960fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:64:04', 'vm-uuid': 'a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: INFO os_vif [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15')
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No VIF found with MAC fa:16:3e:3b:64:04, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:40:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Instance destroyed successfully.
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'resources' on Instance uuid c340e46d-8444-46be-a47f-13e9b91698a4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:34:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2025290862',display_name='tempest-ServerActionsTestOtherA-server-1516910690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2025290862',id=17,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKpiBLxO9zvNmH9pRqPjferHNFACl6Q1N7ER1BXMY38+8VP3w2WxAptO2RkoW5Ya5jqjYC1ncHJTLchxkYUYS9kHNL1Qaa6iHnDh+T85NlnVRGU4dTn2KWL4G3S1fxV61A==',key_name='tempest-keypair-1564305634',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:36:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-0iewr372',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=c340e46d-8444-46be-a47f-13e9b91698a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "b5f1b174-ff03-4f85-9de9-caf34175b732", "address": "fa:16:3e:74:0e:44", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5f1b174-ff", "ovs_interfaceid": "b5f1b174-ff03-4f85-9de9-caf34175b732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG os_vif [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5f1b174-ff, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e312d4fd-e0f8-446c-bc2b-49dc5ade9fe8) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: INFO os_vif [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:0e:44,bridge_name='br-int',has_traffic_filtering=True,id=b5f1b174-ff03-4f85-9de9-caf34175b732,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5f1b174-ff')
Nov 14 03:40:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Deleting instance files /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4_del
Nov 14 03:40:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Deletion of /opt/stack/data/nova/instances/c340e46d-8444-46be-a47f-13e9b91698a4_del complete
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updated VIF entry in instance network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-930444f7-8a09-41eb-b2be-4c8a70586d4a req-fb355a34-bd1d-4ce8-a265-477818e0724e service nova] Releasing lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:25 user nova-compute[74836]: INFO nova.compute.manager [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 03:40:25 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:40:25 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:26 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Took 0.81 seconds to deallocate network for instance.
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:26 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 is timed out.
Nov 14 03:40:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully detached device vdb from instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 from the live domain config.
Nov 14 03:40:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QoZYetpa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:40:26 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ca379f-2891-431f-b54a-e9c779a4dd77]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:40:26 user nova-compute[74836]: No targets found.
Nov 14 03:40:26 user nova-compute[74836]: iSNS:
Nov 14 03:40:26 user nova-compute[74836]: No targets found.
Nov 14 03:40:26 user nova-compute[74836]: STATIC:
Nov 14 03:40:26 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85
Nov 14 03:40:26 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:40:26 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:40:26 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:40:26 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:40:26 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:40:26 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:40:26 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:40:26 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:40:26 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc
Nov 14 03:40:26 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:40:26 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:40:26 user nova-compute[74836]: FIRMWARE:
Nov 14 03:40:26 user nova-compute[74836]: No targets found.
Nov 14 03:40:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:40:26 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:40:26 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-11775d05-ec59-4211-a79c-4e0fced03571 req-68918a79-eba3-4541-b203-55f4f7307ef2 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-deleted-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3054a0-32de-4588-97be-abf82b592b17]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8832deed-7c38-45d8-8527-184b61b13130]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:40:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc (non-flash)
Nov 14 03:40:27 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:40:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4473f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[553df886-de97-4eb4-9ec2-39a7b9de02c1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dfbfdb-fd81-4bf9-97ab-0091c88d342a]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed05cdaf-dbab-4948-9d3e-759b41aa6b2c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed2fc7f-4681-477b-8727-69ba7db3185d]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] Acquiring lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] Lock "c340e46d-8444-46be-a47f-13e9b91698a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] No waiting events found dispatching network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:27 user nova-compute[74836]: WARNING nova.compute.manager [req-2fd8a08b-e9d0-4088-8123-0a0c83c0ccf8 req-201d99f4-1050-4c9e-802b-601dfa809f52 service nova] [instance: c340e46d-8444-46be-a47f-13e9b91698a4] Received unexpected event network-vif-plugged-b5f1b174-ff03-4f85-9de9-caf34175b732 for instance with vm_state deleted and task_state None.
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[090adaa5-95df-4951-82af-40581d15c268]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.696s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa8c04-e3b1-40eb-b950-776c199cc5b4]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260]
Nov 14 03:40:27 user nova-compute[74836]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc, portal: 172.16.0.220,3260] successful.
Nov 14 03:40:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:27 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Deleted allocations for instance c340e46d-8444-46be-a47f-13e9b91698a4
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4edb777-9920-46e8-9901-5006319e73bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0ba053-8309-4909-b6ab-34ef0d9d2a97]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] <== disconnect_volume: return (425ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c97cfead-0245-4996-8f49-e5e736c1fcfc tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "c340e46d-8444-46be-a47f-13e9b91698a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.689s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:28 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'flavor' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d86540c3-e329-4fc9-aedf-ebb718783b31 tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] No waiting events found dispatching network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:29 user nova-compute[74836]: WARNING nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received unexpected event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc for instance with vm_state building and task_state spawning.
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] No waiting events found dispatching network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:29 user nova-compute[74836]: WARNING nova.compute.manager [req-c2566833-968e-447c-9af9-7c5eac6b7bbe req-44766539-96f1-4318-a452-fd55be348e0c service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received unexpected event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc for instance with vm_state building and task_state spawning.
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:40:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Instance spawned successfully.
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:29 user nova-compute[74836]: INFO nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Took 6.47 seconds to spawn the instance on the hypervisor.
Nov 14 03:40:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:40:29 user nova-compute[74836]: INFO nova.compute.manager [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Took 8.15 seconds to build instance.
Nov 14 03:40:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-10b5a102-7202-45fe-8f98-3f8b182ac497 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.297s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:40:52 user nova-compute[74836]: INFO nova.compute.claims [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Claim successful on node user
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:40:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.108s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:40:53 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.policy [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd35f9323ce9c45509413703f3bc6c718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df27ce98f4c4b3dbd2757da6dd61527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:40:53 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Creating image(s)
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "/opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "/opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk 1073741824" returned: 0 in 0.057s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Successfully created port: c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:40:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Cannot resize image /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Ensure instance console log exists: /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Successfully updated port: c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquired lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-changed-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Refreshing instance network info cache due to event network-changed-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] Acquiring lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.neutron [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Updating instance_info_cache with network_info: [{"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Releasing lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Instance network_info: |[{"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] Acquired lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Refreshing network info cache for port c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Start _get_guest_xml network_info=[{"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:40:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:55 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-529355449',display_name='tempest-VolumesActionsTest-instance-529355449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-529355449',id=32,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-ntukzb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:53Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=1a951e6a-ae60-4e0d-b420-02b1806b55c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a951e6a-ae60-4e0d-b420-02b1806b55c1 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:40:55 user nova-compute[74836]:   <uuid>1a951e6a-ae60-4e0d-b420-02b1806b55c1</uuid>
Nov 14 03:40:55 user nova-compute[74836]:   <name>instance-00000020</name>
Nov 14 03:40:55 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:40:55 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:40:55 user nova-compute[74836]:   <metadata>
Nov 14 03:40:55 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:40:55 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:name>tempest-VolumesActionsTest-instance-529355449</nova:name>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:40:55</nova:creationTime>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:40:55 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:40:55 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:owner>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:user uuid="d35f9323ce9c45509413703f3bc6c718">tempest-VolumesActionsTest-883449369-project-member</nova:user>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:project uuid="8df27ce98f4c4b3dbd2757da6dd61527">tempest-VolumesActionsTest-883449369</nova:project>
Nov 14 03:40:55 user nova-compute[74836]:       </nova:owner>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:40:55 user nova-compute[74836]:       <nova:ports>
Nov 14 03:40:55 user nova-compute[74836]:         <nova:port uuid="c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24">
Nov 14 03:40:55 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 03:40:55 user nova-compute[74836]:         </nova:port>
Nov 14 03:40:55 user nova-compute[74836]:       </nova:ports>
Nov 14 03:40:55 user nova-compute[74836]:     </nova:instance>
Nov 14 03:40:55 user nova-compute[74836]:   </metadata>
Nov 14 03:40:55 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:40:55 user nova-compute[74836]:     <system>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="serial">1a951e6a-ae60-4e0d-b420-02b1806b55c1</entry>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="uuid">1a951e6a-ae60-4e0d-b420-02b1806b55c1</entry>
Nov 14 03:40:55 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:40:55 user nova-compute[74836]:     </system>
Nov 14 03:40:55 user nova-compute[74836]:   </sysinfo>
Nov 14 03:40:55 user nova-compute[74836]:   <os>
Nov 14 03:40:55 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:40:55 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:40:55 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:40:55 user nova-compute[74836]:   </os>
Nov 14 03:40:55 user nova-compute[74836]:   <features>
Nov 14 03:40:55 user nova-compute[74836]:     <acpi/>
Nov 14 03:40:55 user nova-compute[74836]:     <apic/>
Nov 14 03:40:55 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:40:55 user nova-compute[74836]:   </features>
Nov 14 03:40:55 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:40:55 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:40:55 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:40:55 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:40:55 user nova-compute[74836]:   </clock>
Nov 14 03:40:55 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:40:55 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:40:55 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:40:55 user nova-compute[74836]:   </cpu>
Nov 14 03:40:55 user nova-compute[74836]:   <devices>
Nov 14 03:40:55 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:40:55 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:40:55 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk"/>
Nov 14 03:40:55 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:40:55 user nova-compute[74836]:     </disk>
Nov 14 03:40:55 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:40:55 user nova-compute[74836]:       <mac address="fa:16:3e:c8:83:a3"/>
Nov 14 03:40:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:55 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:40:55 user nova-compute[74836]:       <target dev="tapc93ac88d-35"/>
Nov 14 03:40:55 user nova-compute[74836]:     </interface>
Nov 14 03:40:55 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:40:55 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/console.log" append="off"/>
Nov 14 03:40:55 user nova-compute[74836]:     </serial>
Nov 14 03:40:55 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:40:55 user nova-compute[74836]:     <video>
Nov 14 03:40:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:40:55 user nova-compute[74836]:     </video>
Nov 14 03:40:55 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:40:55 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:40:55 user nova-compute[74836]:     </rng>
Nov 14 03:40:55 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:40:55 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:40:55 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:40:55 user nova-compute[74836]:     </memballoon>
Nov 14 03:40:55 user nova-compute[74836]:   </devices>
Nov 14 03:40:55 user nova-compute[74836]: </domain>
Nov 14 03:40:55 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-529355449',display_name='tempest-VolumesActionsTest-instance-529355449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-529355449',id=32,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-ntukzb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:40:53Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=1a951e6a-ae60-4e0d-b420-02b1806b55c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG os_vif [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2ba8327-0117-51e8-8659-e79dce7cfaed', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc93ac88d-35, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc93ac88d-35, col_values=(('qos', UUID('4a3859a3-5dbc-4a74-a70d-7d45908928ca')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc93ac88d-35, col_values=(('external_ids', {'iface-id': 'c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:83:a3', 'vm-uuid': '1a951e6a-ae60-4e0d-b420-02b1806b55c1'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: INFO os_vif [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35')
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] No VIF found with MAC fa:16:3e:c8:83:a3, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Updated VIF entry in instance network info cache for port c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Updating instance_info_cache with network_info: [{"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f24a9b-4b34-4d0a-b49f-d9e4f3b6e8cf req-2aacdbad-373a-4eb5-8f76-febfa02ea101 service nova] Releasing lock "refresh_cache-1a951e6a-ae60-4e0d-b420-02b1806b55c1" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] No waiting events found dispatching network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:57 user nova-compute[74836]: WARNING nova.compute.manager [req-5ba364cc-5262-458c-a868-ab90b28faf30 req-b8ee77dc-b5d1-45ab-90ed-49ce793e1dfa service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received unexpected event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 for instance with vm_state building and task_state spawning.
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:40:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Instance spawned successfully.
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lazy-loading 'flavor' on Instance uuid 6911894d-5ac6-43b9-8322-09dcff470226 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:40:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] No waiting events found dispatching network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:40:59 user nova-compute[74836]: WARNING nova.compute.manager [req-4948765b-fc86-47ea-9aa9-c1c4ccddc628 req-394797f0-8d78-47f9-9be6-883a356c70c5 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received unexpected event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 for instance with vm_state building and task_state spawning.
Nov 14 03:40:59 user nova-compute[74836]: INFO nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:40:59 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:59 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6651MB free_disk=24.972007751464844GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:40:59 user nova-compute[74836]: INFO nova.compute.manager [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Attaching volume 0827af12-d7c0-49c1-9db2-22bbfa2c3e9d to /dev/vdb
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:59 user nova-compute[74836]: INFO nova.compute.manager [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Took 7.17 seconds to build instance.
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a7e475-07bf-48cd-b2ed-43ce80a30abd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80c90bd7-caaf-4658-962e-058318bc1b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 852a825d-62a4-4a54-80a9-f62312bca2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 6911894d-5ac6-43b9-8322-09dcff470226 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance df849240-5277-48ec-aac7-cbe35ee857b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 1a951e6a-ae60-4e0d-b420-02b1806b55c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=15GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.050s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d5cab0-785d-44d2-a80f-bb0e9ccb16e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bcf86685-3a73-422a-8e81-6b8f1adca298 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.338s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb78cf90-1861-4a61-87b4-8fca658800ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5c9e48-c6f6-46f7-984b-8c2eabce86e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:40:59 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:40:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9209a07-0597-4959-99d9-e0e388ea69c0]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] <== get_connector_properties: return (218ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:40:59 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updating existing volume attachment record: a6b5f0c9-7659-4cc1-8fbe-ee189853c0b4 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.821s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [{"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-2a266da1-3823-4ae8-b45c-17c1b7543a5a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdiAgbGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:41:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:41:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:41:04 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d74225f-8b1c-4ac7-9ffe-4f6f9ec717dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:41:04 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15cb414-6509-4860-9782-62e8c3318ec7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d] added
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d02acce-6413-4862-8c70-662f9cd94b53]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a9ec72-0a52-45cd-a132-1bc0e1c20c68]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdiAgbGr {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdiAgbGr" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea3786-024a-49c7-80b3-be8c6cc63a92]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdiAgbGr'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a243954-8ca3-40e3-a772-7117f0cc72d7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bea0cc-1f8e-4dfa-8d36-0e96ba13cefa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb43d4d-01ba-4fb5-86f2-73d622fc9786]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260]
Nov 14 03:41:04 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260] successful.
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b860d8c-e6b2-4c2f-9733-abdde961ee67]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[207b02ad-4ec5-4de6-9f0f-f12afd8df027]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:04 user nova-compute[74836]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)
Nov 14 03:41:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5def6d-17c6-4bb7-aafc-fb5bace1805f]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:41:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdiAgbGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23865346366336466', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865346366336466', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lazy-loading 'flavor' on Instance uuid 6911894d-5ac6-43b9-8322-09dcff470226 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:41:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:41:05 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:41:05 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:41:05 user nova-compute[74836]:   <serial>0827af12-d7c0-49c1-9db2-22bbfa2c3e9d</serial>
Nov 14 03:41:05 user nova-compute[74836]: </disk>
Nov 14 03:41:05 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] No VIF found with MAC fa:16:3e:e8:69:05, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing instance network info cache due to event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1ad4468f-5c5c-4bb8-af60-57887fcb6d4c tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.864s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.objects.instance [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'flavor' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.149s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updated VIF entry in instance network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cfd317f6-0bcc-46b7-96ee-f8ada647916e req-dc06cb5b-ac24-45e0-b125-5ebeffdb156d service nova] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:06 user nova-compute[74836]: INFO nova.compute.manager [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Attaching volume 52b77e35-f22f-4bae-9852-6400ef76e5bb to /dev/vdb
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.utils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ccb3ef-ab0b-4547-9d18-a57ecad1b35d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ee5603-9c38-4bc6-9cb6-9dc1e678335a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[259cf16d-74e0-4de5-b469-2d96b2e636b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc682f6-31e6-4183-b3b7-92a9bd532c27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:41:06 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[09639a2f-6606-40ae-ad37-a8a3a887f20a]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG os_brick.utils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating existing volume attachment record: a80114a2-11cf-4649-b8f1-ae99c04dae3b {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:06 user nova-compute[74836]: INFO nova.compute.manager [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Terminating instance
Nov 14 03:41:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-unplugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] No waiting events found dispatching network-vif-unplugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.compute.manager [req-75e949a8-bf8e-40e2-be4a-e093d60ac9c8 req-c1139af9-457b-4580-bdcd-5d23cd5009bc service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-unplugged-7a852930-aec5-4117-80e5-6f7abbb0da04 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Instance destroyed successfully.
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.objects.instance [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lazy-loading 'resources' on Instance uuid 6911894d-5ac6-43b9-8322-09dcff470226 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-233209041',display_name='tempest-DeleteServersTestJSON-server-233209041',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-233209041',id=25,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4da7684a63714ab6b3545526f832c6ff',ramdisk_id='',reservation_id='r-fgr31hk8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-996040629',owner_user_name='tempest-DeleteServersTestJSON-996040629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:39:13Z,user_data=None,user_id='dd47901389614f5588bb2af36d1f53e2',uuid=6911894d-5ac6-43b9-8322-09dcff470226,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converting VIF {"id": "7a852930-aec5-4117-80e5-6f7abbb0da04", "address": "fa:16:3e:e8:69:05", "network": {"id": "124ac12c-1b9d-41be-8f2d-1d9f9b0374a9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1878570491-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4da7684a63714ab6b3545526f832c6ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a852930-ae", "ovs_interfaceid": "7a852930-aec5-4117-80e5-6f7abbb0da04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_vif [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a852930-ae, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1168fe94-205c-4aba-8aa6-58df7689c007) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:07 user nova-compute[74836]: INFO os_vif [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:69:05,bridge_name='br-int',has_traffic_filtering=True,id=7a852930-aec5-4117-80e5-6f7abbb0da04,network=Network(124ac12c-1b9d-41be-8f2d-1d9f9b0374a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a852930-ae')
Nov 14 03:41:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdiAgbGr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:41:07 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab7627-6adf-4708-a52b-94bf3f37e2ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:41:07 user nova-compute[74836]: No targets found.
Nov 14 03:41:07 user nova-compute[74836]: iSNS:
Nov 14 03:41:07 user nova-compute[74836]: No targets found.
Nov 14 03:41:07 user nova-compute[74836]: STATIC:
Nov 14 03:41:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d
Nov 14 03:41:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:41:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:41:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85
Nov 14 03:41:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:41:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:41:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:41:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:41:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:41:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:41:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:41:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:41:07 user nova-compute[74836]: FIRMWARE:
Nov 14 03:41:07 user nova-compute[74836]: No targets found.
Nov 14 03:41:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:41:07 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:41:07 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee075e82-d284-4de0-83d3-e8c755c0bade]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa6db6-7924-4397-9cce-cb02a82563cf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)
Nov 14 03:41:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:07 user nova-compute[74836]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d (non-flash)
Nov 14 03:41:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4224ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5458ee92-7b82-4d2f-8174-09f34d3ba8f9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c1e43c-b905-4c07-bd3f-b824c3ad21b5]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd8c035-e15e-47e2-bfba-fbb28d6a77b7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:41:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d43e610-810e-4e2a-aab2-c77abe46410d]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0db7c-c3e7-4d23-ac3e-1918eb44c9f5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af79f51-e681-45b7-aa6f-b47dbfb27921]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260]
Nov 14 03:41:08 user nova-compute[74836]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d, portal: 172.16.0.220,3260] successful.
Nov 14 03:41:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0827af12-d7c0-49c1-9db2-22bbfa2c3e9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf96f89-029b-41e9-9e0a-21f55e16a037]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] <== disconnect_volume: return (309ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:41:08 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Deleting instance files /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226_del
Nov 14 03:41:08 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Deletion of /opt/stack/data/nova/instances/6911894d-5ac6-43b9-8322-09dcff470226_del complete
Nov 14 03:41:08 user nova-compute[74836]: INFO nova.compute.manager [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 03:41:08 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:08 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Took 0.54 seconds to deallocate network for instance.
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-367b9efe-71d5-45cc-94b8-7e5bfb839867 req-655f38af-4cfd-471a-a434-bfbed8842857 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-deleted-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:08 user nova-compute[74836]: INFO nova.compute.manager [req-367b9efe-71d5-45cc-94b8-7e5bfb839867 req-655f38af-4cfd-471a-a434-bfbed8842857 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Neutron deleted interface 7a852930-aec5-4117-80e5-6f7abbb0da04; detaching it from the instance and deleting it from the info cache
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.network.neutron [req-367b9efe-71d5-45cc-94b8-7e5bfb839867 req-655f38af-4cfd-471a-a434-bfbed8842857 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-367b9efe-71d5-45cc-94b8-7e5bfb839867 req-655f38af-4cfd-471a-a434-bfbed8842857 service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Detach interface failed, port_id=7a852930-aec5-4117-80e5-6f7abbb0da04, reason: Instance 6911894d-5ac6-43b9-8322-09dcff470226 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:09 user nova-compute[74836]: INFO nova.compute.manager [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Terminating instance
Nov 14 03:41:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] Acquiring lock "6911894d-5ac6-43b9-8322-09dcff470226-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] Lock "6911894d-5ac6-43b9-8322-09dcff470226-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] No waiting events found dispatching network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:09 user nova-compute[74836]: WARNING nova.compute.manager [req-235db4fa-7135-480c-bd84-7cb8e87775fb req-1c1a437c-2191-4e1e-aced-d84ca6e25b0a service nova] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Received unexpected event network-vif-plugged-7a852930-aec5-4117-80e5-6f7abbb0da04 for instance with vm_state active and task_state deleting.
Nov 14 03:41:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:09 user nova-compute[74836]: INFO nova.compute.manager [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] [instance: 6911894d-5ac6-43b9-8322-09dcff470226] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 03:41:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:41:09 user nova-compute[74836]: INFO nova.compute.manager [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] instance snapshotting
Nov 14 03:41:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Beginning live snapshot process
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Instance destroyed successfully.
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.objects.instance [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lazy-loading 'resources' on Instance uuid a6de739b-56d4-4d9c-99b5-0228b8ef5c82 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:34:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-295198805',display_name='tempest-SnapshotDataIntegrityTests-server-295198805',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-295198805',id=18,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyNTakOMJfIgkGgt8CliYxtvFaMO85reKKHcbAkPYmPIKUdTbIGn1iItBUlAeUm9hZ5jLvH2XQElIR44nH1cDZ4BolEq7wYhRuBE894w54jSieivC7BAOax67LlTSOGbg==',key_name='tempest-keypair-568819793',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d289f9188434ed4b52606eae4323bbc',ramdisk_id='',reservation_id='r-ri7ttlj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1739200041',owner_user_name='tempest-SnapshotDataIntegrityTests-1739200041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='993f5484239e49b4b0c65f3c806a79c4',uuid=a6de739b-56d4-4d9c-99b5-0228b8ef5c82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converting VIF {"id": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "address": "fa:16:3e:90:40:c3", "network": {"id": "d53fb534-895e-4dfc-b171-69eab193d3c1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1139606631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5d289f9188434ed4b52606eae4323bbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f2012ba-9f", "ovs_interfaceid": "6f2012ba-9faf-4b9e-a763-3f2fa9986a8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG os_vif [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f2012ba-9f, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b6b54e4-7dd5-4e51-a0c4-a42b283c3e2e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:41:10 user nova-compute[74836]: INFO os_vif [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:40:c3,bridge_name='br-int',has_traffic_filtering=True,id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a,network=Network(d53fb534-895e-4dfc-b171-69eab193d3c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f2012ba-9f')
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Deleting instance files /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82_del
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Deletion of /opt/stack/data/nova/instances/a6de739b-56d4-4d9c-99b5-0228b8ef5c82_del complete
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.656s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Deleted allocations for instance 6911894d-5ac6-43b9-8322-09dcff470226
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.compute.manager [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f46adfd6-f418-46e4-948b-3ea207514b96 tempest-DeleteServersTestJSON-996040629 tempest-DeleteServersTestJSON-996040629-project-member] Lock "6911894d-5ac6-43b9-8322-09dcff470226" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.495s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85.delta 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85.delta 1073741824" returned: 0 in 0.051s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-3ca455e1-b3b3-4f3c-bdf7-b058d6a51945 req-d600e025-ec34-46e9-ad91-92feafac8061 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-vif-deleted-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:11 user nova-compute[74836]: INFO nova.compute.manager [req-3ca455e1-b3b3-4f3c-bdf7-b058d6a51945 req-d600e025-ec34-46e9-ad91-92feafac8061 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Neutron deleted interface 6f2012ba-9faf-4b9e-a763-3f2fa9986a8a; detaching it from the instance and deleting it from the info cache
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-3ca455e1-b3b3-4f3c-bdf7-b058d6a51945 req-d600e025-ec34-46e9-ad91-92feafac8061 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:11 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Took 0.90 seconds to deallocate network for instance.
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-3ca455e1-b3b3-4f3c-bdf7-b058d6a51945 req-d600e025-ec34-46e9-ad91-92feafac8061 service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Detach interface failed, port_id=6f2012ba-9faf-4b9e-a763-3f2fa9986a8a, reason: Instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-vif-unplugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] No waiting events found dispatching network-vif-unplugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:11 user nova-compute[74836]: WARNING nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received unexpected event network-vif-unplugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a for instance with vm_state deleted and task_state None.
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Acquiring lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] No waiting events found dispatching network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:11 user nova-compute[74836]: WARNING nova.compute.manager [req-938ac86c-9222-4e60-b34f-bcf4d004ad38 req-38fe73cc-2d7e-4133-973e-4f41cd9361ab service nova] [instance: a6de739b-56d4-4d9c-99b5-0228b8ef5c82] Received unexpected event network-vif-plugged-6f2012ba-9faf-4b9e-a763-3f2fa9986a8a for instance with vm_state deleted and task_state None.
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:41:11 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.664s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:12 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Deleted allocations for instance a6de739b-56d4-4d9c-99b5-0228b8ef5c82
Nov 14 03:41:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFdEOWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:41:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:41:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:41:12 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f360ca-6232-4ca5-a660-668ed691484a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:41:12 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7f2a61-0157-4a74-86b8-1b4b5ae5d040]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb] added
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00bef91e-49fd-4c4c-ac9f-c90f3f32e1ef tempest-SnapshotDataIntegrityTests-1739200041 tempest-SnapshotDataIntegrityTests-1739200041-project-member] Lock "a6de739b-56d4-4d9c-99b5-0228b8ef5c82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e48b86-1910-42eb-9763-f299724780aa]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d8d324-4191-4e03-856f-c4df6b409a6f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFdEOWeP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFdEOWeP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b496ea89-7d39-48b7-9035-d864777f0b0b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFdEOWeP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6d930-d3a0-43fc-a164-2b3ca084a1cd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85.delta /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9efce2f-8116-4be9-8cbf-b1c3c8c8647c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f2c745-1d5e-4aac-a94b-fb1b391da0e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260]
Nov 14 03:41:12 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260] successful.
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aff776-b83d-4c1a-a52a-e56cbcf926ee]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab65612-35d6-4d27-8af0-ed90aad1faec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:41:12 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:41:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c262d8-5d18-4729-a0c5-494c3c40fbc2]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:41:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85.delta /opt/stack/data/nova/instances/snapshots/tmpmk7s9xaa/df3a7883805e480189e3ee5a921eeb85" returned: 0 in 0.492s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:12 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Snapshot extracted, beginning image upload
Nov 14 03:41:13 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFdEOWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26539623339636535', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539623339636535', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.objects.instance [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'flavor' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:41:13 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:41:13 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:41:13 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:41:13 user nova-compute[74836]:   <serial>52b77e35-f22f-4bae-9852-6400ef76e5bb</serial>
Nov 14 03:41:13 user nova-compute[74836]: </disk>
Nov 14 03:41:13 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:44:e0:64, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:41:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-578a2853-3540-4b9c-a2dd-18c16c179aed tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.364s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:14 user nova-compute[74836]: INFO nova.compute.manager [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Rescuing
Nov 14 03:41:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:41:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Snapshot image upload complete
Nov 14 03:41:15 user nova-compute[74836]: INFO nova.compute.manager [None req-d69b8335-7aff-48cf-bbc4-4de26bc81c4f tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Took 5.46 seconds to snapshot the instance on the hypervisor.
Nov 14 03:41:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:15 user nova-compute[74836]: WARNING nova.compute.manager [req-906ea9a2-2ac0-4553-af3a-50af190de894 req-01f62e42-b559-4d41-984d-8f739b425436 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state active and task_state rescuing.
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance destroyed successfully.
Nov 14 03:41:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Attempting rescue
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:41:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Creating image(s)
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing instance network info cache due to event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue" returned: 0 in 0.048s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'migration_context' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<01faa8a1-4b13-4d21-a1e6-01953fe394c8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start _get_guest_xml network_info=[{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:44:e0:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<01faa8a1-4b13-4d21-a1e6-01953fe394c8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'numa_topology' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<01faa8a1-4b13-4d21-a1e6-01953fe394c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:41:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<01faa8a1-4b13-4d21-a1e6-01953fe394c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578475611',display_name='tempest-ServerRescueNegativeTestJSON-server-578475611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578475611',id=26,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+dP51TtQPExAfVDCt6Kg0ib7rMc/PTi/ROlHFD8cNiWvNwwiBtKlwiJavZF+eVqLy160yksGdfM7Iqsg1Mnh/cuteoGQpwBkNKRdzJPJ/k6IIXseo7iTAGQvqGt43Dw==',key_name='tempest-keypair-62033315',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-oyp39kbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c470afaa49c481cbf37c789908133d7',uuid=01faa8a1-4b13-4d21-a1e6-01953fe394c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:44:e0:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "vif_mac": "fa:16:3e:44:e0:64"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'pci_devices' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.objects.base [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Object Instance<01faa8a1-4b13-4d21-a1e6-01953fe394c8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:41:16 user nova-compute[74836]:   <uuid>01faa8a1-4b13-4d21-a1e6-01953fe394c8</uuid>
Nov 14 03:41:16 user nova-compute[74836]:   <name>instance-0000001a</name>
Nov 14 03:41:16 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:41:16 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:41:16 user nova-compute[74836]:   <metadata>
Nov 14 03:41:16 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:41:16 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-578475611</nova:name>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:41:16</nova:creationTime>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:41:16 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:41:16 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:owner>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:user uuid="8c470afaa49c481cbf37c789908133d7">tempest-ServerRescueNegativeTestJSON-57849908-project-member</nova:user>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:project uuid="aa969498730e4839bbd15d990c31977d">tempest-ServerRescueNegativeTestJSON-57849908</nova:project>
Nov 14 03:41:16 user nova-compute[74836]:       </nova:owner>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:41:16 user nova-compute[74836]:       <nova:ports>
Nov 14 03:41:16 user nova-compute[74836]:         <nova:port uuid="2d882c7e-fe70-4388-b57e-cb89619a2bd6">
Nov 14 03:41:16 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 03:41:16 user nova-compute[74836]:         </nova:port>
Nov 14 03:41:16 user nova-compute[74836]:       </nova:ports>
Nov 14 03:41:16 user nova-compute[74836]:     </nova:instance>
Nov 14 03:41:16 user nova-compute[74836]:   </metadata>
Nov 14 03:41:16 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:41:16 user nova-compute[74836]:     <system>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="serial">01faa8a1-4b13-4d21-a1e6-01953fe394c8</entry>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="uuid">01faa8a1-4b13-4d21-a1e6-01953fe394c8</entry>
Nov 14 03:41:16 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:41:16 user nova-compute[74836]:     </system>
Nov 14 03:41:16 user nova-compute[74836]:   </sysinfo>
Nov 14 03:41:16 user nova-compute[74836]:   <os>
Nov 14 03:41:16 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:41:16 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:41:16 user nova-compute[74836]:   </os>
Nov 14 03:41:16 user nova-compute[74836]:   <features>
Nov 14 03:41:16 user nova-compute[74836]:     <acpi/>
Nov 14 03:41:16 user nova-compute[74836]:     <apic/>
Nov 14 03:41:16 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:41:16 user nova-compute[74836]:   </features>
Nov 14 03:41:16 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:41:16 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:41:16 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:41:16 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:41:16 user nova-compute[74836]:   </clock>
Nov 14 03:41:16 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:41:16 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:41:16 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:41:16 user nova-compute[74836]:   </cpu>
Nov 14 03:41:16 user nova-compute[74836]:   <devices>
Nov 14 03:41:16 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:41:16 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:41:16 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue"/>
Nov 14 03:41:16 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:41:16 user nova-compute[74836]:     </disk>
Nov 14 03:41:16 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:41:16 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:41:16 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk"/>
Nov 14 03:41:16 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:41:16 user nova-compute[74836]:     </disk>
Nov 14 03:41:16 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:41:16 user nova-compute[74836]:       <mac address="fa:16:3e:44:e0:64"/>
Nov 14 03:41:16 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:41:16 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:41:16 user nova-compute[74836]:       <target dev="tap2d882c7e-fe"/>
Nov 14 03:41:16 user nova-compute[74836]:     </interface>
Nov 14 03:41:16 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:41:16 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/console.log" append="off"/>
Nov 14 03:41:16 user nova-compute[74836]:     </serial>
Nov 14 03:41:16 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:41:16 user nova-compute[74836]:     <video>
Nov 14 03:41:16 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:41:16 user nova-compute[74836]:     </video>
Nov 14 03:41:16 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:41:16 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:41:16 user nova-compute[74836]:     </rng>
Nov 14 03:41:16 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:41:16 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:41:16 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:41:16 user nova-compute[74836]:     </memballoon>
Nov 14 03:41:16 user nova-compute[74836]:   </devices>
Nov 14 03:41:16 user nova-compute[74836]: </domain>
Nov 14 03:41:16 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:41:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance destroyed successfully.
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] No VIF found with MAC fa:16:3e:44:e0:64, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updated VIF entry in instance network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-051fdce3-bc9c-4cad-962b-ed2c3ddc3bbc req-0d378c3a-2236-4b9c-9962-8f03bb7e1893 service nova] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:17 user nova-compute[74836]: WARNING nova.compute.manager [req-31fbf3d0-70eb-4608-8032-b08073d9bc16 req-9e65af32-21d8-49c4-a92b-68ec9f869f53 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state active and task_state rescuing.
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:19 user nova-compute[74836]: INFO nova.compute.manager [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Shelving
Nov 14 03:41:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:19 user nova-compute[74836]: WARNING nova.compute.manager [req-56338aac-5791-4788-9368-34d4bee90e2f req-00550f28-d1b6-4fb3-aafe-5a69d10497fd service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state active and task_state shelving.
Nov 14 03:41:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance destroyed successfully.
Nov 14 03:41:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Beginning cold snapshot process
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk /opt/stack/data/nova/instances/snapshots/tmp7grzuvu7/6b119ea2568548bd8b9511224be37ac4 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:19 user nova-compute[74836]: WARNING nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state active and task_state rescuing.
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:19 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:19 user nova-compute[74836]: WARNING nova.compute.manager [req-bf54b4f4-135b-4d4d-9af8-e079b7fae4e9 req-998b476c-026d-42fd-8872-0f51dfbdff04 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state active and task_state rescuing.
Nov 14 03:41:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-520430e1-f96f-4091-805e-1c3b553acd31 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:41:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk /opt/stack/data/nova/instances/snapshots/tmp7grzuvu7/6b119ea2568548bd8b9511224be37ac4" returned: 0 in 0.894s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Snapshot extracted, beginning image upload
Nov 14 03:41:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:41:21 user nova-compute[74836]: WARNING nova.compute.manager [req-0a726c61-b3cb-498c-82e2-e52d0365304b req-bfcd1967-0b24-4b9e-829b-8c00ec424c21 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 03:41:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Snapshot image upload complete
Nov 14 03:41:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:41:23 user nova-compute[74836]: INFO nova.compute.manager [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Shelve offloading
Nov 14 03:41:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance destroyed successfully.
Nov 14 03:41:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:41:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance destroyed successfully.
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'resources' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt4lSXlVx0s1RrjRFU10g22o0ubqBwvFva9WW+DhqwgdeYy4Sb/6B6Mm39Fosth8aOToFc2q7CoT/CCDrkQQzfA+8+O9a7L3fELu7kMYdQVlCcxJ4f26hU9sQ5Xx2tQ1A==',key_name='tempest-keypair-200914316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:41:23.523401',shelved_host='user',shelved_image_id='5a4af312-c4bd-4d6a-9134-f394bdd0b0aa'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:41:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG os_vif [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f596b10-ed, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33c68539-c82c-4152-8e93-7145da53efe2) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing instance network info cache due to event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:41:24 user nova-compute[74836]: INFO os_vif [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed')
Nov 14 03:41:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Deleting instance files /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634_del
Nov 14 03:41:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Deletion of /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634_del complete
Nov 14 03:41:25 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Deleted allocations for instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634
Nov 14 03:41:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.objects.instance [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'numa_topology' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.objects.base [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<3199c66c-37e1-4ce9-af73-4c9c00fb3634> lazy-loaded attributes: resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updated VIF entry in instance network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7f596b10-ed", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9cb265e8-465d-476c-8663-95be9a99abb1 req-7339eb62-4a9f-4c43-bb98-417129dd3500 service nova] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-18879c64-1309-4301-a323-2a0ae14e004d tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.550s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing instance network info cache due to event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updated VIF entry in instance network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1b20daec-e4d8-403e-97e5-aaee8f3294f5 req-cb454908-31c4-4f54-a61a-f680f224cf95 service nova] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:41:42 user nova-compute[74836]: INFO nova.compute.manager [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] instance snapshotting
Nov 14 03:41:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Beginning live snapshot process
Nov 14 03:41:42 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38.delta 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38.delta 1073741824" returned: 0 in 0.046s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 03:41:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:41:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] COPY block job progress, current cursor: 47906816 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:41:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:41:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 03:41:45 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:41:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38.delta /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38.delta /opt/stack/data/nova/instances/snapshots/tmpjru8gf42/2fa6b21ba4874ed6a59f7504e9be7b38" returned: 0 in 0.343s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Snapshot extracted, beginning image upload
Nov 14 03:41:48 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Snapshot image upload complete
Nov 14 03:41:48 user nova-compute[74836]: INFO nova.compute.manager [None req-f43de3f3-6132-41d1-ba6b-544546e38f88 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Took 5.51 seconds to snapshot the instance on the hypervisor.
Nov 14 03:41:48 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:41:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:41:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:41:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing instance network info cache due to event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updated VIF entry in instance network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f622620-d525-4b29-87b2-9a6e902dbcf6 req-e97ab872-7da2-4c41-99f5-ee457d3f26b7 service nova] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing instance network info cache due to event network-changed-9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] Acquiring lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] Acquired lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:41:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Refreshing network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:55 user nova-compute[74836]: INFO nova.compute.manager [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Detaching volume 86cef820-0edd-4f34-a4ed-964c66102b85
Nov 14 03:41:55 user nova-compute[74836]: INFO nova.virt.block_device [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Attempting to driver detach volume 86cef820-0edd-4f34-a4ed-964c66102b85 from mountpoint /dev/vdb
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Attempting to detach device vdb from instance 80c90bd7-caaf-4658-962e-058318bc1b23 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:41:55 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:41:55 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:41:55 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:41:55 user nova-compute[74836]:   <serial>86cef820-0edd-4f34-a4ed-964c66102b85</serial>
Nov 14 03:41:55 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:41:55 user nova-compute[74836]: </disk>
Nov 14 03:41:55 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:41:55 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully detached device vdb from instance 80c90bd7-caaf-4658-962e-058318bc1b23 from the persistent domain config.
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80c90bd7-caaf-4658-962e-058318bc1b23 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:41:55 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:41:55 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:41:55 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:41:55 user nova-compute[74836]:   <serial>86cef820-0edd-4f34-a4ed-964c66102b85</serial>
Nov 14 03:41:55 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:41:55 user nova-compute[74836]: </disk>
Nov 14 03:41:55 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updated VIF entry in instance network info cache for port 9e139afc-b787-4622-8105-8f76bc27a8a5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.network.neutron [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [{"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4d0e9e2-a75a-4322-a0a0-8c478d925d83 req-c900cafe-aae9-43ae-836a-7ddaee4fc618 service nova] Releasing lock "refresh_cache-80c90bd7-caaf-4658-962e-058318bc1b23" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:41:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:41:59 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:41:59 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7054MB free_disk=24.869003295898438GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80c90bd7-caaf-4658-962e-058318bc1b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 852a825d-62a4-4a54-80a9-f62312bca2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance df849240-5277-48ec-aac7-cbe35ee857b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 1a951e6a-ae60-4e0d-b420-02b1806b55c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:41:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.801s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:42:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-changed-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Refreshing instance network info cache due to event network-changed-bc71d157-317b-4b86-b48e-86a248845b89. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] Acquiring lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] Acquired lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Refreshing network info cache for port bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:01 user nova-compute[74836]: INFO nova.compute.manager [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Terminating instance
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updated VIF entry in instance network info cache for port bc71d157-317b-4b86-b48e-86a248845b89. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updating instance_info_cache with network_info: [{"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a2917c94-5036-4771-b9da-2a7958d61293 req-c7d23727-cbb8-483b-9439-f22bf2a763fb service nova] Releasing lock "refresh_cache-df849240-5277-48ec-aac7-cbe35ee857b6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-unplugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] No waiting events found dispatching network-vif-unplugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-c33bd3a5-347a-4477-bf0a-01a1041938aa req-741cd5cd-1577-4ff7-8f71-599285973530 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-unplugged-bc71d157-317b-4b86-b48e-86a248845b89 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Instance destroyed successfully.
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.objects.instance [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'resources' on Instance uuid df849240-5277-48ec-aac7-cbe35ee857b6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-680413040',display_name='tempest-AttachVolumeNegativeTest-server-680413040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-680413040',id=30,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM7Fbee6sypIzlAc9U8WUena0e3/gyFjpKyhobv4FhnWv/jgtBCrM9hkkRWGMBCTUV02nzmgt9gt+F093xocoTUb84uhPCpsE5iPjRAInCuGvcUcnUdjmpZc5ZKaHgLPA==',key_name='tempest-keypair-493137995',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:40:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-2jjkpgjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:40:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=df849240-5277-48ec-aac7-cbe35ee857b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "bc71d157-317b-4b86-b48e-86a248845b89", "address": "fa:16:3e:d6:ba:35", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc71d157-31", "ovs_interfaceid": "bc71d157-317b-4b86-b48e-86a248845b89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG os_vif [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc71d157-31, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccce49c7-b550-46f4-a879-48bc93cfe467) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:02 user nova-compute[74836]: INFO os_vif [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ba:35,bridge_name='br-int',has_traffic_filtering=True,id=bc71d157-317b-4b86-b48e-86a248845b89,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc71d157-31')
Nov 14 03:42:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Deleting instance files /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6_del
Nov 14 03:42:02 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Deletion of /opt/stack/data/nova/instances/df849240-5277-48ec-aac7-cbe35ee857b6_del complete
Nov 14 03:42:02 user nova-compute[74836]: INFO nova.compute.manager [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:42:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:03 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:03 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Took 0.84 seconds to deallocate network for instance.
Nov 14 03:42:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:03 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:03 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:03 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Deleted allocations for instance df849240-5277-48ec-aac7-cbe35ee857b6
Nov 14 03:42:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fba8827d-f050-4254-95f1-186bc4d760cc tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "df849240-5277-48ec-aac7-cbe35ee857b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.447s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] Acquiring lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] Lock "df849240-5277-48ec-aac7-cbe35ee857b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] No waiting events found dispatching network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:04 user nova-compute[74836]: WARNING nova.compute.manager [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received unexpected event network-vif-plugged-bc71d157-317b-4b86-b48e-86a248845b89 for instance with vm_state deleted and task_state None.
Nov 14 03:42:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-a494eeaa-ab9a-4fbc-be01-1c36f61b0edc req-6e7da54b-8d64-411b-81ed-577ffd863db8 service nova] [instance: df849240-5277-48ec-aac7-cbe35ee857b6] Received event network-vif-deleted-bc71d157-317b-4b86-b48e-86a248845b89 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing instance network info cache due to event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] Acquiring lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] Acquired lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:13 user nova-compute[74836]: DEBUG nova.objects.instance [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updated VIF entry in instance network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d6cb3ca0-c03a-4038-8d53-d0ac5d2d7335 req-f9e9fed3-7b99-4eac-ada0-121714f96c6f service nova] Releasing lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:14 user nova-compute[74836]: INFO nova.compute.manager [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Attaching volume ba1ca26d-fe17-4e76-9b75-d2430a110d1d to /dev/vdb
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.utils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c5e217-f641-4cfb-b247-0ad65f52cbf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e11c3f1-328b-4b1d-b8f1-4b217156b23b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db6073-bf10-4179-8e84-ff61bfbae96c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f2181b-2f54-4f92-af5b-9bd3055ce8cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:14 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf297d9-1e18-4c6c-92f4-fa9faec56c29]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG os_brick.utils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating existing volume attachment record: 1eb1e8a5-bc41-4eda-921b-3257ca8e89db {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:14 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:42:14 user nova-compute[74836]: INFO nova.compute.claims [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Claim successful on node user
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:42:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.policy [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b1b556cd49347c0bca921f02527a3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e55bd47c746b472496433ecbbc6115c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:42:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Creating image(s)
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80c90bd7-caaf-4658-962e-058318bc1b23 is timed out.
Nov 14 03:42:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully detached device vdb from instance 80c90bd7-caaf-4658-962e-058318bc1b23 from the live domain config.
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwDTzrqg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:15 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ebc67-90b7-4aa3-aba2-138ddac73177]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:42:15 user nova-compute[74836]: No targets found.
Nov 14 03:42:15 user nova-compute[74836]: iSNS:
Nov 14 03:42:15 user nova-compute[74836]: No targets found.
Nov 14 03:42:15 user nova-compute[74836]: STATIC:
Nov 14 03:42:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85
Nov 14 03:42:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:42:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:42:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:42:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:15 user nova-compute[74836]: FIRMWARE:
Nov 14 03:42:15 user nova-compute[74836]: No targets found.
Nov 14 03:42:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:42:15 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:42:15 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74cf958-b2d9-4815-b9af-7440c3cbd2da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ab05f-5c06-479d-95b9-a89119059d69]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:15 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43f0310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c74da8-f993-4503-a322-e2a667e0baaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk 1073741824" returned: 0 in 0.058s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8d4aa5-980d-4277-870e-fe776f1f5306]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f34239a-935a-4855-8aab-0616b901a00f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5afb1d5-f632-4e0c-b874-95b6cc110bd8]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Successfully created port: b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[834c62bb-c634-493f-a3c0-0543690407fd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e469b6-811d-4de8-af9d-9049d1efb9bb]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260]
Nov 14 03:42:16 user nova-compute[74836]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85, portal: 172.16.0.220,3260] successful.
Nov 14 03:42:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86cef820-0edd-4f34-a4ed-964c66102b85 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b248b-6495-415b-a8e1-72c54339702a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] <== disconnect_volume: return (441ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Cannot resize image /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Ensure instance console log exists: /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Successfully updated port: b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-changed-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Refreshing instance network info cache due to event network-changed-b549e8cc-909f-4450-9b90-afd13379e321. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'flavor' on Instance uuid 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ce6d4900-bb26-4a14-8d36-b615e6205038 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.813s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.network.neutron [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance network_info: |[{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Refreshing network info cache for port b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:42:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start _get_guest_xml network_info=[{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:42:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'pci_devices' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:42:17 user nova-compute[74836]:   <uuid>80245c74-184f-47a3-8b7f-37bea4240a7a</uuid>
Nov 14 03:42:17 user nova-compute[74836]:   <name>instance-00000021</name>
Nov 14 03:42:17 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:42:17 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:42:17 user nova-compute[74836]:   <metadata>
Nov 14 03:42:17 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:42:17 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077651375</nova:name>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:42:16</nova:creationTime>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:42:17 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:42:17 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:owner>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:user uuid="6b1b556cd49347c0bca921f02527a3bf">tempest-ServerActionsTestOtherB-1529116963-project-member</nova:user>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:project uuid="e55bd47c746b472496433ecbbc6115c3">tempest-ServerActionsTestOtherB-1529116963</nova:project>
Nov 14 03:42:17 user nova-compute[74836]:       </nova:owner>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:42:17 user nova-compute[74836]:       <nova:ports>
Nov 14 03:42:17 user nova-compute[74836]:         <nova:port uuid="b549e8cc-909f-4450-9b90-afd13379e321">
Nov 14 03:42:17 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:42:17 user nova-compute[74836]:         </nova:port>
Nov 14 03:42:17 user nova-compute[74836]:       </nova:ports>
Nov 14 03:42:17 user nova-compute[74836]:     </nova:instance>
Nov 14 03:42:17 user nova-compute[74836]:   </metadata>
Nov 14 03:42:17 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:42:17 user nova-compute[74836]:     <system>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="serial">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="uuid">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:42:17 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:42:17 user nova-compute[74836]:     </system>
Nov 14 03:42:17 user nova-compute[74836]:   </sysinfo>
Nov 14 03:42:17 user nova-compute[74836]:   <os>
Nov 14 03:42:17 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:42:17 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:42:17 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:42:17 user nova-compute[74836]:   </os>
Nov 14 03:42:17 user nova-compute[74836]:   <features>
Nov 14 03:42:17 user nova-compute[74836]:     <acpi/>
Nov 14 03:42:17 user nova-compute[74836]:     <apic/>
Nov 14 03:42:17 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:42:17 user nova-compute[74836]:   </features>
Nov 14 03:42:17 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:42:17 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:42:17 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:42:17 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:42:17 user nova-compute[74836]:   </clock>
Nov 14 03:42:17 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:42:17 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:42:17 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:42:17 user nova-compute[74836]:   </cpu>
Nov 14 03:42:17 user nova-compute[74836]:   <devices>
Nov 14 03:42:17 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:42:17 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:42:17 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk"/>
Nov 14 03:42:17 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:42:17 user nova-compute[74836]:     </disk>
Nov 14 03:42:17 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:42:17 user nova-compute[74836]:       <mac address="fa:16:3e:dd:69:0b"/>
Nov 14 03:42:17 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:17 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:42:17 user nova-compute[74836]:       <target dev="tapb549e8cc-90"/>
Nov 14 03:42:17 user nova-compute[74836]:     </interface>
Nov 14 03:42:17 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:42:17 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/console.log" append="off"/>
Nov 14 03:42:17 user nova-compute[74836]:     </serial>
Nov 14 03:42:17 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:42:17 user nova-compute[74836]:     <video>
Nov 14 03:42:17 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:17 user nova-compute[74836]:     </video>
Nov 14 03:42:17 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:42:17 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:42:17 user nova-compute[74836]:     </rng>
Nov 14 03:42:17 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:42:17 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:42:17 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:42:17 user nova-compute[74836]:     </memballoon>
Nov 14 03:42:17 user nova-compute[74836]:   </devices>
Nov 14 03:42:17 user nova-compute[74836]: </domain>
Nov 14 03:42:17 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG os_vif [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae9ba8a6-8699-5051-a104-1a2bf7e8eae8', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb549e8cc-90, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb549e8cc-90, col_values=(('qos', UUID('f4c651e8-7b66-45d3-9a56-b61db951690b')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb549e8cc-90, col_values=(('external_ids', {'iface-id': 'b549e8cc-909f-4450-9b90-afd13379e321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:69:0b', 'vm-uuid': '80245c74-184f-47a3-8b7f-37bea4240a7a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:17 user nova-compute[74836]: INFO os_vif [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No VIF found with MAC fa:16:3e:dd:69:0b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updated VIF entry in instance network info cache for port b549e8cc-909f-4450-9b90-afd13379e321. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1aa22231-71c4-412d-acaa-5da832ad5a31 req-fce0914b-38a1-4d8c-9a53-5b9c5e80c8d7 service nova] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:17 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:42:17 user nova-compute[74836]: INFO nova.compute.claims [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Claim successful on node user
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:18 user nova-compute[74836]: WARNING nova.compute.manager [req-dd9cbc69-dd3f-4004-aab2-7ed732e9be49 req-60819ad2-e0be-4c2c-8e71-3cee332e0be9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state building and task_state spawning.
Nov 14 03:42:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:42:18 user nova-compute[74836]: INFO nova.virt.block_device [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Booting with volume-backed-image 430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5 at /dev/vda
Nov 14 03:42:18 user nova-compute[74836]: DEBUG nova.policy [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7107bdffb0544dd890311071f04662ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353de76529e464c82aa0d303b797362', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrABHMmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:19 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:19 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:19 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd72a3-8315-4f85-8ec4-8e64639393f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:42:19 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[403d76cb-1878-45f9-8c34-1a96517d7a13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d] added
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc7098e-e3be-475a-aa9f-8dd13a0c76b1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[df172d27-4d47-49c5-9dba-39a59e0c1ba3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OrABHMmS {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OrABHMmS" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbab0100-8e73-4c49-af75-72797c985469]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OrABHMmS'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e1b8c-76ab-42df-b412-6854e9391012]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fda3659-58b7-4df8-8392-7cb3dca4e2f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebae720-fded-4747-ba9f-9747995ae4b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260]
Nov 14 03:42:19 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260] successful.
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[188371ce-739a-4171-b553-d5c7490aa457]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad4be03-e723-41dd-811f-de3025646f32]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:19 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a2aabc-fd88-4ece-aa80-90b1234827eb]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrABHMmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:42:19 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Successfully created port: 2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26462303566653832', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462303566653832', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.objects.instance [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Successfully updated port: 2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:42:20 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:20 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:42:20 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:42:20 user nova-compute[74836]:   <serial>ba1ca26d-fe17-4e76-9b75-d2430a110d1d</serial>
Nov 14 03:42:20 user nova-compute[74836]: </disk>
Nov 14 03:42:20 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:20 user nova-compute[74836]: WARNING nova.compute.manager [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state building and task_state spawning.
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-changed-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Refreshing instance network info cache due to event network-changed-2294d5c3-da92-4af3-bc08-654e34b222e8. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Acquiring lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:42:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance spawned successfully.
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating instance_info_cache with network_info: [{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance network_info: |[{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Acquired lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:20 user nova-compute[74836]: DEBUG nova.network.neutron [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Refreshing network info cache for port 2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:42:21 user nova-compute[74836]: INFO nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No VIF found with MAC fa:16:3e:3b:64:04, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:42:21 user nova-compute[74836]: INFO nova.compute.manager [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Took 6.48 seconds to build instance.
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1d20e76b-b519-4cb2-a48b-7eaf2740de64 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.574s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-afdaf833-8571-4c91-a69c-81400b2a8604 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.076s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updated VIF entry in instance network info cache for port 2294d5c3-da92-4af3-bc08-654e34b222e8. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.network.neutron [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating instance_info_cache with network_info: [{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:21 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:42:21 user nova-compute[74836]: INFO nova.compute.claims [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Claim successful on node user
Nov 14 03:42:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d81fabba-f58d-40e1-a818-dcd697fad806 req-e07c14b7-0a07-4dfb-8f69-2c1d51fa28f9 service nova] Releasing lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.724s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:42:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.policy [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9aff38e58fe4a1b8bd4d46ceda55ba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06e7a009680c4c6d80ab5bb26d05b100', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:42:22 user nova-compute[74836]: INFO nova.virt.block_device [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Booting with volume 3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa at /dev/vda
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.utils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e490f8b-58da-4d72-93a4-b2c1be9201f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d97cac-0bb5-4425-9c05-b09da1eb4fe2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce8301-075d-4257-b775-9a8944870cc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4347d28-9351-4d3c-bd7b-2edb8d49f334]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:22 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:42:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31824529-6fbe-4454-b023-20df733ec94d]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG os_brick.utils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:22 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating existing volume attachment record: b54dc654-b298-4111-a5ab-df212e12c135 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Successfully created port: bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:23 user nova-compute[74836]: INFO nova.compute.manager [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Detaching volume ba1ca26d-fe17-4e76-9b75-d2430a110d1d
Nov 14 03:42:23 user nova-compute[74836]: INFO nova.virt.block_device [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Attempting to driver detach volume ba1ca26d-fe17-4e76-9b75-d2430a110d1d from mountpoint /dev/vdb
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Attempting to detach device vdb from instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:42:23 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:23 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:42:23 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:42:23 user nova-compute[74836]:   <serial>ba1ca26d-fe17-4e76-9b75-d2430a110d1d</serial>
Nov 14 03:42:23 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:42:23 user nova-compute[74836]: </disk>
Nov 14 03:42:23 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:42:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully detached device vdb from instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 from the persistent domain config.
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:42:23 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:23 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:42:23 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:42:23 user nova-compute[74836]:   <serial>ba1ca26d-fe17-4e76-9b75-d2430a110d1d</serial>
Nov 14 03:42:23 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:42:23 user nova-compute[74836]: </disk>
Nov 14 03:42:23 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Successfully updated port: bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-changed-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Refreshing instance network info cache due to event network-changed-bbefd00c-ed80-4225-b8a2-fb748de8ff46. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:42:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance network_info: |[{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Refreshing network info cache for port bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.utils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea46302-35cb-4b67-a2fc-e845c017f4b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7829a38-2719-42fd-920d-e2256fe1a833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b29b363-1a8f-4869-8e0e-74d861f53ee3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[37140cf7-7e82-4f32-96db-c4223cba63bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:42:24 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8228a3a-dae1-4424-92aa-ae675078d4e9]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG os_brick.utils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating existing volume attachment record: 8cc0544e-5ca6-46ac-92eb-28cccf676e3c {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updated VIF entry in instance network info cache for port bbefd00c-ed80-4225-b8a2-fb748de8ff46. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d7a935b7-f5c5-4bbc-bedf-a18616a406be req-f82ebb9f-ae51-43c8-ac61-7fc6098c2ae7 service nova] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:42:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:42:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Creating image(s)
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Ensure instance console log exists: /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start _get_guest_xml network_info=[{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '974f1e28-ceff-4235-99d5-0c3e34273482', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf3973b6-e973-47e1-b8a0-d552af152c23', 'serial': 'bf3973b6-e973-47e1-b8a0-d552af152c23'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8cc0544e-5ca6-46ac-92eb-28cccf676e3c', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:42:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Creating image(s)
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Ensure instance console log exists: /opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start _get_guest_xml network_info=[{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ef95a37-bfa0-4af9-9ed8-993af09116f6', 'attached_at': '', 'detached_at': '', 'volume_id': '3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'serial': '3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b54dc654-b298-4111-a5ab-df212e12c135', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:42:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:31 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:31 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:31 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:31 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:31 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea615a5-d0e7-4697-a12e-cd9556b8c67f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:42:31 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c50ad0-8ef3-40fb-91fc-1ac0e992ac50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23] added
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[43527114-c06b-4d9e-b606-5e6aa3a6468d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3973a394-24b5-4ce8-a61c-fd0bb19946f0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgRVvlTC {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgRVvlTC" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8c25c-2047-4051-b1be-7302c5ded477]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgRVvlTC'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218079a-6164-4dcc-9fe9-6f028fd9713a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[960e2b0f-d9e1-4551-a037-5fe1f789df72]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e48bcc2-4a86-4fdf-94d7-cf1fbaa39480]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260]
Nov 14 03:42:31 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260] successful.
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[58db3411-c34b-4e4d-a38e-1475e7391122]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[74687ad8-7205-4ead-82e0-4af70fa3e84a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:31 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b509c-6d57-4128-b7b4-3bc148593d70]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:42:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23039346438613834', 'path': '/dev/sdf'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039346438613834', 'path': '/dev/sdf'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.288s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:32 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e36a97c-5182-4bb7-adfb-3f736cf9c2da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:42:32 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839081279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839081279',id=34,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-6g2mx4wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:19Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=974f1e28-ceff-4235-99d5-0c3e34273482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.objects.instance [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:42:32 user nova-compute[74836]:   <uuid>974f1e28-ceff-4235-99d5-0c3e34273482</uuid>
Nov 14 03:42:32 user nova-compute[74836]:   <name>instance-00000022</name>
Nov 14 03:42:32 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:42:32 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:42:32 user nova-compute[74836]:   <metadata>
Nov 14 03:42:32 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:42:32 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839081279</nova:name>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:42:31</nova:creationTime>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:42:32 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:42:32 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:owner>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:42:32 user nova-compute[74836]:       </nova:owner>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:42:32 user nova-compute[74836]:       <nova:ports>
Nov 14 03:42:32 user nova-compute[74836]:         <nova:port uuid="2294d5c3-da92-4af3-bc08-654e34b222e8">
Nov 14 03:42:32 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:42:32 user nova-compute[74836]:         </nova:port>
Nov 14 03:42:32 user nova-compute[74836]:       </nova:ports>
Nov 14 03:42:32 user nova-compute[74836]:     </nova:instance>
Nov 14 03:42:32 user nova-compute[74836]:   </metadata>
Nov 14 03:42:32 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:42:32 user nova-compute[74836]:     <system>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="serial">974f1e28-ceff-4235-99d5-0c3e34273482</entry>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="uuid">974f1e28-ceff-4235-99d5-0c3e34273482</entry>
Nov 14 03:42:32 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:42:32 user nova-compute[74836]:     </system>
Nov 14 03:42:32 user nova-compute[74836]:   </sysinfo>
Nov 14 03:42:32 user nova-compute[74836]:   <os>
Nov 14 03:42:32 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:42:32 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:42:32 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:42:32 user nova-compute[74836]:   </os>
Nov 14 03:42:32 user nova-compute[74836]:   <features>
Nov 14 03:42:32 user nova-compute[74836]:     <acpi/>
Nov 14 03:42:32 user nova-compute[74836]:     <apic/>
Nov 14 03:42:32 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:42:32 user nova-compute[74836]:   </features>
Nov 14 03:42:32 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:42:32 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:42:32 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:42:32 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:42:32 user nova-compute[74836]:   </clock>
Nov 14 03:42:32 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:42:32 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:42:32 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:42:32 user nova-compute[74836]:   </cpu>
Nov 14 03:42:32 user nova-compute[74836]:   <devices>
Nov 14 03:42:32 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:42:32 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:32 user nova-compute[74836]:       <source dev="/dev/sdf"/>
Nov 14 03:42:32 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:42:32 user nova-compute[74836]:       <serial>bf3973b6-e973-47e1-b8a0-d552af152c23</serial>
Nov 14 03:42:32 user nova-compute[74836]:     </disk>
Nov 14 03:42:32 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:42:32 user nova-compute[74836]:       <mac address="fa:16:3e:39:2b:e2"/>
Nov 14 03:42:32 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:32 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:42:32 user nova-compute[74836]:       <target dev="tap2294d5c3-da"/>
Nov 14 03:42:32 user nova-compute[74836]:     </interface>
Nov 14 03:42:32 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:42:32 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/console.log" append="off"/>
Nov 14 03:42:32 user nova-compute[74836]:     </serial>
Nov 14 03:42:32 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:42:32 user nova-compute[74836]:     <video>
Nov 14 03:42:32 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:32 user nova-compute[74836]:     </video>
Nov 14 03:42:32 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:42:32 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:42:32 user nova-compute[74836]:     </rng>
Nov 14 03:42:32 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:42:32 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:42:32 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:42:32 user nova-compute[74836]:     </memballoon>
Nov 14 03:42:32 user nova-compute[74836]:   </devices>
Nov 14 03:42:32 user nova-compute[74836]: </domain>
Nov 14 03:42:32 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839081279',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839081279',id=34,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-6g2mx4wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:19Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=974f1e28-ceff-4235-99d5-0c3e34273482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_vif [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[894d77fc-d5e0-46aa-b983-44347b61bba4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa] added
Nov 14 03:42:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffd0ec20-e4f4-5350-a3dc-cbd30cc55396', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2294d5c3-da, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2294d5c3-da, col_values=(('qos', UUID('cd1b2569-e7f6-4b6e-9c9e-9cab73fd6ebf')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2294d5c3-da, col_values=(('external_ids', {'iface-id': '2294d5c3-da92-4af3-bc08-654e34b222e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2b:e2', 'vm-uuid': '974f1e28-ceff-4235-99d5-0c3e34273482'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdf2903-bc2d-4dc0-8da7-1f9cc6fd90a6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:32 user nova-compute[74836]: INFO os_vif [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da')
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8f4627-4392-4fd7-97e6-78b31ccfab1f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNSDozwl {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNSDozwl" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[de82c96f-a1bd-48b8-bc96-b512ececc670]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNSDozwl'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:39:2b:e2, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d887c3-9419-4d55-8dc0-6ced97a927cf]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd59811-8336-4e30-bc94-631526ee81a5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ed7a4-b3ec-419d-a6c0-78f05f536450]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]
Nov 14 03:42:33 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.
Nov 14 03:42:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1346443-9033-4f73-b6cf-d03aa11d8fc2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e5303-2975-479c-acf3-6cde0101dba9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:42:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:33 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:42:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42cb518-9260-463a-89c9-e9cbc3dec3d5]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:42:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== connect_volume: return (2656ms) {'type': 'block', 'scsi_wwn': '26139336230343565', 'path': '/dev/sdg'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139336230343565', 'path': '/dev/sdg'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ef95a37-bfa0-4af9-9ed8-993af09116f6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:42:34 user nova-compute[74836]:   <uuid>7ef95a37-bfa0-4af9-9ed8-993af09116f6</uuid>
Nov 14 03:42:34 user nova-compute[74836]:   <name>instance-00000023</name>
Nov 14 03:42:34 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:42:34 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:42:34 user nova-compute[74836]:   <metadata>
Nov 14 03:42:34 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:42:34 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:42:34 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherA-server-1028770785</nova:name>
Nov 14 03:42:34 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:42:31</nova:creationTime>
Nov 14 03:42:34 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:42:34 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:42:34 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:42:34 user nova-compute[74836]:       <nova:owner>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:user uuid="f9aff38e58fe4a1b8bd4d46ceda55ba3">tempest-ServerActionsTestOtherA-585001335-project-member</nova:user>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:project uuid="06e7a009680c4c6d80ab5bb26d05b100">tempest-ServerActionsTestOtherA-585001335</nova:project>
Nov 14 03:42:34 user nova-compute[74836]:       </nova:owner>
Nov 14 03:42:34 user nova-compute[74836]:       <nova:ports>
Nov 14 03:42:34 user nova-compute[74836]:         <nova:port uuid="bbefd00c-ed80-4225-b8a2-fb748de8ff46">
Nov 14 03:42:34 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:42:34 user nova-compute[74836]:         </nova:port>
Nov 14 03:42:34 user nova-compute[74836]:       </nova:ports>
Nov 14 03:42:34 user nova-compute[74836]:     </nova:instance>
Nov 14 03:42:34 user nova-compute[74836]:   </metadata>
Nov 14 03:42:34 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:42:34 user nova-compute[74836]:     <system>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="serial">7ef95a37-bfa0-4af9-9ed8-993af09116f6</entry>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="uuid">7ef95a37-bfa0-4af9-9ed8-993af09116f6</entry>
Nov 14 03:42:34 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:42:34 user nova-compute[74836]:     </system>
Nov 14 03:42:34 user nova-compute[74836]:   </sysinfo>
Nov 14 03:42:34 user nova-compute[74836]:   <os>
Nov 14 03:42:34 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:42:34 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:42:34 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:42:34 user nova-compute[74836]:   </os>
Nov 14 03:42:34 user nova-compute[74836]:   <features>
Nov 14 03:42:34 user nova-compute[74836]:     <acpi/>
Nov 14 03:42:34 user nova-compute[74836]:     <apic/>
Nov 14 03:42:34 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:42:34 user nova-compute[74836]:   </features>
Nov 14 03:42:34 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:42:34 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:42:34 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:42:34 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:42:34 user nova-compute[74836]:   </clock>
Nov 14 03:42:34 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:42:34 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:42:34 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:42:34 user nova-compute[74836]:   </cpu>
Nov 14 03:42:34 user nova-compute[74836]:   <devices>
Nov 14 03:42:34 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:42:34 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:34 user nova-compute[74836]:       <source dev="/dev/sdg"/>
Nov 14 03:42:34 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:42:34 user nova-compute[74836]:       <serial>3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa</serial>
Nov 14 03:42:34 user nova-compute[74836]:     </disk>
Nov 14 03:42:34 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:42:34 user nova-compute[74836]:       <mac address="fa:16:3e:ed:09:e5"/>
Nov 14 03:42:34 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:34 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:42:34 user nova-compute[74836]:       <target dev="tapbbefd00c-ed"/>
Nov 14 03:42:34 user nova-compute[74836]:     </interface>
Nov 14 03:42:34 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:42:34 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6/console.log" append="off"/>
Nov 14 03:42:34 user nova-compute[74836]:     </serial>
Nov 14 03:42:34 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:42:34 user nova-compute[74836]:     <video>
Nov 14 03:42:34 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:42:34 user nova-compute[74836]:     </video>
Nov 14 03:42:34 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:42:34 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:42:34 user nova-compute[74836]:     </rng>
Nov 14 03:42:34 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:42:34 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:42:34 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:42:34 user nova-compute[74836]:     </memballoon>
Nov 14 03:42:34 user nova-compute[74836]:   </devices>
Nov 14 03:42:34 user nova-compute[74836]: </domain>
Nov 14 03:42:34 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG os_vif [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd48efd86-773f-5e42-9817-1293910ef8bb', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbefd00c-ed, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbefd00c-ed, col_values=(('qos', UUID('4522f777-19c3-45b1-af6d-8c4a8e5e7108')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbefd00c-ed, col_values=(('external_ids', {'iface-id': 'bbefd00c-ed80-4225-b8a2-fb748de8ff46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:09:e5', 'vm-uuid': '7ef95a37-bfa0-4af9-9ed8-993af09116f6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: INFO os_vif [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed')
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:ed:09:e5, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:34 user nova-compute[74836]: WARNING nova.compute.manager [req-c960fffe-3f0e-44c9-886c-9f3454c74f6b req-bcad8529-d852-4b5a-b408-0a3c023cb093 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state building and task_state spawning.
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:36 user nova-compute[74836]: WARNING nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state building and task_state spawning.
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:36 user nova-compute[74836]: WARNING nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state building and task_state spawning.
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:36 user nova-compute[74836]: WARNING nova.compute.manager [req-3efb9a57-6909-4d33-b87d-e37e979f6f5a req-40cc562e-fe76-489c-bcf9-47ed444e3373 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state building and task_state spawning.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance spawned successfully.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.compute.manager [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Took 19.66 seconds to build instance.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-077072de-802e-40b5-9f3e-8b87894cf4ab tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.843s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance spawned successfully.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:42:37 user nova-compute[74836]: INFO nova.compute.manager [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Took 16.26 seconds to build instance.
Nov 14 03:42:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ff9fe465-15ab-483b-b3ad-36f617afe7c4 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.377s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:43 user nova-compute[74836]: INFO nova.compute.manager [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Terminating instance
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-unplugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] No waiting events found dispatching network-vif-unplugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-848dd9f3-2751-4075-a337-499f78a5b7aa req-88fe3d41-ddd4-4205-934e-40462ac3b5e0 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-unplugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:42:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Instance destroyed successfully.
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.objects.instance [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lazy-loading 'resources' on Instance uuid 1a951e6a-ae60-4e0d-b420-02b1806b55c1 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-529355449',display_name='tempest-VolumesActionsTest-instance-529355449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-529355449',id=32,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:40:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-ntukzb0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:41:00Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=1a951e6a-ae60-4e0d-b420-02b1806b55c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "address": "fa:16:3e:c8:83:a3", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc93ac88d-35", "ovs_interfaceid": "c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG os_vif [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc93ac88d-35, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a3859a3-5dbc-4a74-a70d-7d45908928ca) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:43 user nova-compute[74836]: INFO os_vif [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:83:a3,bridge_name='br-int',has_traffic_filtering=True,id=c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc93ac88d-35')
Nov 14 03:42:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Deleting instance files /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1_del
Nov 14 03:42:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Deletion of /opt/stack/data/nova/instances/1a951e6a-ae60-4e0d-b420-02b1806b55c1_del complete
Nov 14 03:42:43 user nova-compute[74836]: INFO nova.compute.manager [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 03:42:43 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:42:43 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:42:44 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 is timed out.
Nov 14 03:42:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully detached device vdb from instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 from the live domain config.
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OrABHMmS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:42:44 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeea61f-047a-4df4-b6b1-8dd64b5b82a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:42:44 user nova-compute[74836]: No targets found.
Nov 14 03:42:44 user nova-compute[74836]: iSNS:
Nov 14 03:42:44 user nova-compute[74836]: No targets found.
Nov 14 03:42:44 user nova-compute[74836]: STATIC:
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d
Nov 14 03:42:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:42:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:42:44 user nova-compute[74836]: FIRMWARE:
Nov 14 03:42:44 user nova-compute[74836]: No targets found.
Nov 14 03:42:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:42:44 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:42:44 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc576ffb-94b5-486f-96a0-36255db6a4a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d3bd1b-1964-4314-be83-fe0bfb021363]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:42:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:42:44 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:42:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4466b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Took 0.45 seconds to deallocate network for instance.
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-edaec48a-14b2-49d7-a11a-3d5d43283501 req-f6570ce3-2dd9-4956-b822-7a8a9081b5dc service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-deleted-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a6af2-9ee0-46d7-8715-3dfacc386866]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bcea0c-8ff7-4a63-9fa2-ef0228d26405]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afd0c58-673d-4096-9032-23b5357ae70e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8a1a0-764a-4301-82d9-2df6d8c2f00b]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad8cc3-47a5-4b05-8cab-5e31b1f917b0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20f77ec-efdc-45cb-8b1c-eb78b19dfd5f]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260]
Nov 14 03:42:44 user nova-compute[74836]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d, portal: 172.16.0.220,3260] successful.
Nov 14 03:42:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba1ca26d-fe17-4e76-9b75-d2430a110d1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1fd87-3585-470c-b9f4-3b804842650a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== disconnect_volume: return (342ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:44 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Deleted allocations for instance 1a951e6a-ae60-4e0d-b420-02b1806b55c1
Nov 14 03:42:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-cbba7d68-c165-4c69-b239-9f4f7b821cfd tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] Acquiring lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] Lock "1a951e6a-ae60-4e0d-b420-02b1806b55c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] No waiting events found dispatching network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:45 user nova-compute[74836]: WARNING nova.compute.manager [req-bf2b6cac-e890-4c43-a715-b235d0f66c50 req-7f8dca71-f2d8-477d-95da-7ca8b15a8008 service nova] [instance: 1a951e6a-ae60-4e0d-b420-02b1806b55c1] Received unexpected event network-vif-plugged-c93ac88d-35ea-4c8f-9e22-6cbf2aab8a24 for instance with vm_state deleted and task_state None.
Nov 14 03:42:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ebbebf-15ac-42e8-a6d3-d817f1491549 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:47 user nova-compute[74836]: INFO nova.compute.manager [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Terminating instance
Nov 14 03:42:47 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-aed411e0-d770-440e-a518-00710748bafa req-da1319e0-e91a-4953-bb47-0cf204d72e75 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-unplugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:42:48 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Instance destroyed successfully.
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lazy-loading 'resources' on Instance uuid 80c90bd7-caaf-4658-962e-058318bc1b23 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-748462573',display_name='tempest-TestMinimumBasicScenario-server-748462573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-748462573',id=23,image_ref='a17330b6-935d-4e02-b055-1d77291d3623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9TbnfxFJHNDklojQxUWaCqqp0CGbbNTtyUhkRcy7lbcBRdPT0qaHA7JgRrF94tXdwZSoKM6WBBX5GdJdmVXdyA4NrpIbhDGTWP7sUtrtW2cWIvZ4i3OLfqJ9O0j3shfA==',key_name='tempest-TestMinimumBasicScenario-672904228',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:38:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2c60d13f8c14f9a9849ba536a716032',ramdisk_id='',reservation_id='r-xrmv60zq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a17330b6-935d-4e02-b055-1d77291d3623',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-84832661',owner_user_name='tempest-TestMinimumBasicScenario-84832661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:40:10Z,user_data=None,user_id='f7460cb84c194287b1bcbf512bd98ff5',uuid=80c90bd7-caaf-4658-962e-058318bc1b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converting VIF {"id": "9e139afc-b787-4622-8105-8f76bc27a8a5", "address": "fa:16:3e:a4:43:0e", "network": {"id": "a114588f-45c4-48c4-90dc-c35ab1fa78d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1046885453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2c60d13f8c14f9a9849ba536a716032", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e139afc-b7", "ovs_interfaceid": "9e139afc-b787-4622-8105-8f76bc27a8a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG os_vif [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e139afc-b7, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afd91ad3-c75e-4097-a68b-b49958944f8e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:48 user nova-compute[74836]: INFO os_vif [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:43:0e,bridge_name='br-int',has_traffic_filtering=True,id=9e139afc-b787-4622-8105-8f76bc27a8a5,network=Network(a114588f-45c4-48c4-90dc-c35ab1fa78d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e139afc-b7')
Nov 14 03:42:48 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Deleting instance files /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23_del
Nov 14 03:42:48 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Deletion of /opt/stack/data/nova/instances/80c90bd7-caaf-4658-962e-058318bc1b23_del complete
Nov 14 03:42:48 user nova-compute[74836]: INFO nova.compute.manager [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 03:42:48 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:42:48 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:42:48 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Took 0.41 seconds to deallocate network for instance.
Nov 14 03:42:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:49 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:49 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Deleted allocations for instance 80c90bd7-caaf-4658-962e-058318bc1b23
Nov 14 03:42:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3876f511-c5b7-4a35-9216-deb6091a9977 tempest-TestMinimumBasicScenario-84832661 tempest-TestMinimumBasicScenario-84832661-project-member] Lock "80c90bd7-caaf-4658-962e-058318bc1b23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:49 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] Acquiring lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] Lock "80c90bd7-caaf-4658-962e-058318bc1b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] No waiting events found dispatching network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:42:50 user nova-compute[74836]: WARNING nova.compute.manager [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received unexpected event network-vif-plugged-9e139afc-b787-4622-8105-8f76bc27a8a5 for instance with vm_state deleted and task_state None.
Nov 14 03:42:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-df610258-ce31-47bd-9d9b-7ce57582027a req-b7344766-b5a9-425a-a659-3aa3102456e0 service nova] [instance: 80c90bd7-caaf-4658-962e-058318bc1b23] Received event network-vif-deleted-9e139afc-b787-4622-8105-8f76bc27a8a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:50 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:53 user nova-compute[74836]: INFO nova.compute.manager [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Detaching volume 2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:42:53 user nova-compute[74836]: INFO nova.virt.block_device [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Attempting to driver detach volume 2a268a6e-24d5-44a6-bbd0-021419fc510a from mountpoint /dev/vdb
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Attempting to detach device vdb from instance 852a825d-62a4-4a54-80a9-f62312bca2d6 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:42:53 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:53 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:42:53 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:42:53 user nova-compute[74836]:   <serial>2a268a6e-24d5-44a6-bbd0-021419fc510a</serial>
Nov 14 03:42:53 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:42:53 user nova-compute[74836]: </disk>
Nov 14 03:42:53 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:42:53 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance 852a825d-62a4-4a54-80a9-f62312bca2d6 from the persistent domain config.
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 852a825d-62a4-4a54-80a9-f62312bca2d6 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:42:53 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:42:53 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:42:53 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:42:53 user nova-compute[74836]:   <serial>2a268a6e-24d5-44a6-bbd0-021419fc510a</serial>
Nov 14 03:42:53 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:42:53 user nova-compute[74836]: </disk>
Nov 14 03:42:53 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:42:53 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:42:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:58 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=24.91811752319336GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 852a825d-62a4-4a54-80a9-f62312bca2d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 974f1e28-ceff-4235-99d5-0c3e34273482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:42:58 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:42:59 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:42:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:42:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:42:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:06 user nova-compute[74836]: INFO nova.compute.manager [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Unrescuing
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG nova.network.neutron [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG nova.network.neutron [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG nova.objects.instance [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'flavor' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:06 user nova-compute[74836]: WARNING nova.compute.manager [req-fe9af5cc-8919-488c-b9f6-6e3f18088fb9 req-11a1370c-6d93-4357-ba49-91507f1e1800 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance destroyed successfully.
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:08 user nova-compute[74836]: WARNING nova.compute.manager [req-e58b5823-1108-4ecb-888b-3920c2f1865b req-91452cca-b17e-4c79-ae15-7854708f98af service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-09ced691-4c5a-420b-a8a2-4e14fd3bba19 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:10 user nova-compute[74836]: WARNING nova.compute.manager [req-3b77f72d-1de8-4d73-824a-6df1b2c1a78d req-3b215eb4-3724-4a92-b4ed-47300dbf62e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:11 user nova-compute[74836]: INFO nova.compute.manager [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Unshelving
Nov 14 03:43:11 user nova-compute[74836]: INFO nova.virt.block_device [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Booting with volume b27fea05-38c3-4fec-893f-57769bff4ec5 at /dev/vdc
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.utils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24db4ec5-d4f1-47cd-b7d9-2cb68e965362]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33acacf-5b19-4b9d-a58c-80c4486a31d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d573365-5cff-4d84-8180-b69ca3ec5c48]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f473bdf-18cb-4514-93b3-98a9a8f8399c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:43:11 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:43:11 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a21f1f-096c-4b34-bebf-6dbdae737198]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG os_brick.utils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:11 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating existing volume attachment record: ce322ba1-8694-409d-8e6a-d0b3909ceae3 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:13 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 852a825d-62a4-4a54-80a9-f62312bca2d6 is timed out.
Nov 14 03:43:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance 852a825d-62a4-4a54-80a9-f62312bca2d6 from the live domain config.
Nov 14 03:43:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vLetponh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:13 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[acda364f-d523-4937-b069-de4d8c8c6339]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:43:13 user nova-compute[74836]: No targets found.
Nov 14 03:43:13 user nova-compute[74836]: iSNS:
Nov 14 03:43:13 user nova-compute[74836]: No targets found.
Nov 14 03:43:13 user nova-compute[74836]: STATIC:
Nov 14 03:43:13 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:43:13 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:43:13 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:43:13 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:43:13 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:43:13 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:43:13 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:43:13 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:43:13 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:43:13 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:43:13 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:43:13 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:43:13 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a
Nov 14 03:43:13 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:43:13 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:43:13 user nova-compute[74836]: FIRMWARE:
Nov 14 03:43:13 user nova-compute[74836]: No targets found.
Nov 14 03:43:13 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:43:13 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:43:13 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a18c860-ab7d-4707-94cd-91a7197fcf64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa4fa85-3d27-496c-aed7-bac50ffec7ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:13 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:13 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:13 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44aed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:43:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78702e4-fd7d-434b-93f9-09ad62923cf1]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ccc504-60c3-439f-ab65-a9c1d92c5fb5]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c9ac03-5152-4e8b-9073-4762c3d59c1c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91521b8-27cf-43a9-9e38-a92bbad18132]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4c7cba-df59-4b84-aee5-39eac47b30d4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e576f500-4481-46df-b3d9-b6c2b7045ac9]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260]
Nov 14 03:43:14 user nova-compute[74836]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a, portal: 172.16.0.220,3260] successful.
Nov 14 03:43:14 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a268a6e-24d5-44a6-bbd0-021419fc510a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d010c0-59f1-4a17-9834-36ea8fa963fa]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== disconnect_volume: return (360ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:43:15 user nova-compute[74836]: DEBUG nova.objects.instance [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-16dc144a-3a02-4024-991c-3e34e6812c85 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:16 user nova-compute[74836]: INFO nova.compute.manager [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] instance snapshotting
Nov 14 03:43:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Beginning live snapshot process
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_requests' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'numa_topology' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:43:16 user nova-compute[74836]: INFO nova.compute.claims [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Claim successful on node user
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json -f qcow2 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:43:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7.delta 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7.delta 1073741824" returned: 0 in 0.051s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 03:43:17 user nova-compute[74836]: INFO nova.network.neutron [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating port 7f596b10-ed9f-4904-9fde-62f789fd56dd with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing instance network info cache due to event network-changed-7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] Acquiring lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74836) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 03:43:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:43:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Creating image(s)
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] Acquired lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.network.neutron [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Refreshing network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.objects.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<3199c66c-37e1-4ce9-af73-4c9c00fb3634> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:43:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7.delta /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7.delta /opt/stack/data/nova/instances/snapshots/tmpbzr3m3qy/e4134ff690af48079ad797db8ad6aec7" returned: 0 in 0.978s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Snapshot extracted, beginning image upload
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG nova.virt.images [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] 5a4af312-c4bd-4d6a-9134-f394bdd0b0aa was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.part /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updated VIF entry in instance network info cache for port 7f596b10-ed9f-4904-9fde-62f789fd56dd. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG nova.network.neutron [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6f19ffdb-6833-4762-82dc-65a6b4dbff31 req-e776da43-825d-4a20-941a-bee7bb577917 service nova] Releasing lock "refresh_cache-3199c66c-37e1-4ce9-af73-4c9c00fb3634" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.part /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.converted" returned: 0 in 0.395s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.761s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85,backing_fmt=raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85,backing_fmt=raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk 1073741824" returned: 0 in 0.045s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3cd33a17db8699957a0ae0dcee794cff851d5d85" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 --force-share --output=json" returned: 0 in 0.167s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'migration_context' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG nova.objects.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<3199c66c-37e1-4ce9-af73-4c9c00fb3634> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Rebasing disk image.
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 -F raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Snapshot image upload complete
Nov 14 03:43:22 user nova-compute[74836]: INFO nova.compute.manager [None req-975bce1e-2089-4150-b26c-3d01af797030 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Took 6.28 seconds to snapshot the instance on the hypervisor.
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 -F raw /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk" returned: 0 in 2.540s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Ensure instance console log exists: /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start _get_guest_xml network_info=[{"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d0d929c1b33939aa6af4ba36ee206508',container_format='bare',created_at=2023-11-14T03:41:19Z,direct_url=<?>,disk_format='qcow2',id=5a4af312-c4bd-4d6a-9134-f394bdd0b0aa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-654954825-shelved',owner='42a8a057308442f981535f38628faa53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T03:41:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBywbeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '3199c66c-37e1-4ce9-af73-4c9c00fb3634', 'attached_at': '', 'detached_at': '', 'volume_id': 'b27fea05-38c3-4fec-893f-57769bff4ec5', 'serial': 'b27fea05-38c3-4fec-893f-57769bff4ec5'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'attachment_id': 'ce322ba1-8694-409d-8e6a-d0b3909ceae3', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:43:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d0d929c1b33939aa6af4ba36ee206508',container_format='bare',created_at=2023-11-14T03:41:19Z,direct_url=<?>,disk_format='qcow2',id=5a4af312-c4bd-4d6a-9134-f394bdd0b0aa,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-654954825-shelved',owner='42a8a057308442f981535f38628faa53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T03:41:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.objects.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<3199c66c-37e1-4ce9-af73-4c9c00fb3634> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBywbeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:23 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a3132e-a4b9-4775-8a61-0b627ec42188]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:43:23 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa03ac-0e41-47bc-b43e-b03e5d64a83f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5] added
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d98f49-f715-48ad-b515-58f96a557e9f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb4f61-2b23-4753-b7e5-4a951ac4e9a2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBywbeqr {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBywbeqr" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2924554-9d80-4ee8-b627-88ca764882ee]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBywbeqr'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6e1f09-0b01-4f9c-894f-1b5f63a8d40f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[82070c08-75b2-4e56-86b9-870daa5ebc0e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7917362-27a9-48eb-88cf-fdf598befd56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260]
Nov 14 03:43:23 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260] successful.
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[16391668-9743-48c4-8028-25fc6fd1a403]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb9281-5ce5-4905-b61f-fd89328f3c63]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[94917f1c-2f73-4e6b-a284-12c407631703]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:43:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBywbeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:43:24 user nova-compute[74836]: INFO nova.compute.claims [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Claim successful on node user
Nov 14 03:43:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23962316436366136', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962316436366136', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='5a4af312-c4bd-4d6a-9134-f394bdd0b0aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-200914316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:41:23.523401',shelved_host='user',shelved_image_id='5a4af312-c4bd-4d6a-9134-f394bdd0b0aa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_devices' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.objects.base [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<3199c66c-37e1-4ce9-af73-4c9c00fb3634> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:43:24 user nova-compute[74836]:   <uuid>3199c66c-37e1-4ce9-af73-4c9c00fb3634</uuid>
Nov 14 03:43:24 user nova-compute[74836]:   <name>instance-0000001c</name>
Nov 14 03:43:24 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:43:24 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:43:24 user nova-compute[74836]:   <metadata>
Nov 14 03:43:24 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:43:24 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-654954825</nova:name>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:43:23</nova:creationTime>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:43:24 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:43:24 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:owner>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:user uuid="77ede53dd4ff404fbf5575c29105308b">tempest-AttachVolumeShelveTestJSON-267361624-project-member</nova:user>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:project uuid="42a8a057308442f981535f38628faa53">tempest-AttachVolumeShelveTestJSON-267361624</nova:project>
Nov 14 03:43:24 user nova-compute[74836]:       </nova:owner>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:root type="image" uuid="5a4af312-c4bd-4d6a-9134-f394bdd0b0aa"/>
Nov 14 03:43:24 user nova-compute[74836]:       <nova:ports>
Nov 14 03:43:24 user nova-compute[74836]:         <nova:port uuid="7f596b10-ed9f-4904-9fde-62f789fd56dd">
Nov 14 03:43:24 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:43:24 user nova-compute[74836]:         </nova:port>
Nov 14 03:43:24 user nova-compute[74836]:       </nova:ports>
Nov 14 03:43:24 user nova-compute[74836]:     </nova:instance>
Nov 14 03:43:24 user nova-compute[74836]:   </metadata>
Nov 14 03:43:24 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:43:24 user nova-compute[74836]:     <system>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="serial">3199c66c-37e1-4ce9-af73-4c9c00fb3634</entry>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="uuid">3199c66c-37e1-4ce9-af73-4c9c00fb3634</entry>
Nov 14 03:43:24 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:43:24 user nova-compute[74836]:     </system>
Nov 14 03:43:24 user nova-compute[74836]:   </sysinfo>
Nov 14 03:43:24 user nova-compute[74836]:   <os>
Nov 14 03:43:24 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:43:24 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:43:24 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:43:24 user nova-compute[74836]:   </os>
Nov 14 03:43:24 user nova-compute[74836]:   <features>
Nov 14 03:43:24 user nova-compute[74836]:     <acpi/>
Nov 14 03:43:24 user nova-compute[74836]:     <apic/>
Nov 14 03:43:24 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:43:24 user nova-compute[74836]:   </features>
Nov 14 03:43:24 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:43:24 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:43:24 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:43:24 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:43:24 user nova-compute[74836]:   </clock>
Nov 14 03:43:24 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:43:24 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:43:24 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:43:24 user nova-compute[74836]:   </cpu>
Nov 14 03:43:24 user nova-compute[74836]:   <devices>
Nov 14 03:43:24 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:43:24 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:43:24 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk"/>
Nov 14 03:43:24 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:43:24 user nova-compute[74836]:     </disk>
Nov 14 03:43:24 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:43:24 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:43:24 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:43:24 user nova-compute[74836]:       <target dev="vdc" bus="virtio"/>
Nov 14 03:43:24 user nova-compute[74836]:       <serial>b27fea05-38c3-4fec-893f-57769bff4ec5</serial>
Nov 14 03:43:24 user nova-compute[74836]:     </disk>
Nov 14 03:43:24 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:43:24 user nova-compute[74836]:       <mac address="fa:16:3e:3e:16:8c"/>
Nov 14 03:43:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:24 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:43:24 user nova-compute[74836]:       <target dev="tap7f596b10-ed"/>
Nov 14 03:43:24 user nova-compute[74836]:     </interface>
Nov 14 03:43:24 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:43:24 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/console.log" append="off"/>
Nov 14 03:43:24 user nova-compute[74836]:     </serial>
Nov 14 03:43:24 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:43:24 user nova-compute[74836]:     <video>
Nov 14 03:43:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:24 user nova-compute[74836]:     </video>
Nov 14 03:43:24 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:43:24 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:43:24 user nova-compute[74836]:     </rng>
Nov 14 03:43:24 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:43:24 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:43:24 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:43:24 user nova-compute[74836]:     </memballoon>
Nov 14 03:43:24 user nova-compute[74836]:   </devices>
Nov 14 03:43:24 user nova-compute[74836]: </domain>
Nov 14 03:43:24 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='5a4af312-c4bd-4d6a-9134-f394bdd0b0aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-200914316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:41:23.523401',shelved_host='user',shelved_image_id='5a4af312-c4bd-4d6a-9134-f394bdd0b0aa'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG os_vif [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3606f147-4af3-5ca6-bdab-e199837bc378', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f596b10-ed, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f596b10-ed, col_values=(('qos', UUID('3731f3e1-9e8a-4c6a-b51d-cc98c28c902d')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f596b10-ed, col_values=(('external_ids', {'iface-id': '7f596b10-ed9f-4904-9fde-62f789fd56dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:16:8c', 'vm-uuid': '3199c66c-37e1-4ce9-af73-4c9c00fb3634'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:43:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:24 user nova-compute[74836]: INFO os_vif [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed')
Nov 14 03:43:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No VIF found with MAC fa:16:3e:3e:16:8c, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:43:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.policy [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed5afea1b58e4115957a8435f15ec95f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66e650c0a29644dcbbb797a589e94729', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:43:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Creating image(s)
Nov 14 03:43:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "/opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "/opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Successfully created port: 3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.virt.images [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.part /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.part /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.converted" returned: 0 in 0.273s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:26 user nova-compute[74836]: WARNING nova.compute.manager [req-82326a00-13a1-408d-aec6-106c592d4692 req-2da6b274-4cae-4192-8e7b-20e6b809b8c9 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Successfully updated port: 3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.618s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquired lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-changed-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing instance network info cache due to event network-changed-3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] Acquiring lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3,backing_fmt=raw /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating instance_info_cache with network_info: [{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3,backing_fmt=raw /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk 1073741824" returned: 0 in 0.047s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "5d3fa8473c88ae734ec70f1242174419227bc4c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Releasing lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Instance network_info: |[{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] Acquired lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Ensure instance console log exists: /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Start _get_guest_xml network_info=[{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9363b88c51b2146051a7579d70c53983',container_format='bare',created_at=2023-11-14T03:43:16Z,direct_url=<?>,disk_format='qcow2',id=f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-768643973',owner='66e650c0a29644dcbbb797a589e94729',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T03:43:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': 'f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:43:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9363b88c51b2146051a7579d70c53983',container_format='bare',created_at=2023-11-14T03:43:16Z,direct_url=<?>,disk_format='qcow2',id=f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-768643973',owner='66e650c0a29644dcbbb797a589e94729',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T03:43:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-685729348',display_name='tempest-TestStampPattern-server-685729348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-685729348',id=36,image_ref='f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-gwwxvmtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99',image_min_disk='1',image_min_ram='0',image_owner_id='66e650c0a29644dcbbb797a589e94729',image_owner_project_name='tempest-TestStampPattern-6640805',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-6640805-project-member',image_user_id='ed5afea1b58e4115957a8435f15ec95f',network_allocated='True',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:25Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=8e7f7ece-9b05-4a83-925d-cc7fbbb5802b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.objects.instance [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:43:27 user nova-compute[74836]:   <uuid>8e7f7ece-9b05-4a83-925d-cc7fbbb5802b</uuid>
Nov 14 03:43:27 user nova-compute[74836]:   <name>instance-00000024</name>
Nov 14 03:43:27 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:43:27 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:43:27 user nova-compute[74836]:   <metadata>
Nov 14 03:43:27 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:43:27 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:name>tempest-TestStampPattern-server-685729348</nova:name>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:43:27</nova:creationTime>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:43:27 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:43:27 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:owner>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:user uuid="ed5afea1b58e4115957a8435f15ec95f">tempest-TestStampPattern-6640805-project-member</nova:user>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:project uuid="66e650c0a29644dcbbb797a589e94729">tempest-TestStampPattern-6640805</nova:project>
Nov 14 03:43:27 user nova-compute[74836]:       </nova:owner>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:root type="image" uuid="f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b"/>
Nov 14 03:43:27 user nova-compute[74836]:       <nova:ports>
Nov 14 03:43:27 user nova-compute[74836]:         <nova:port uuid="3f10538b-1826-413f-a37d-4f0238167af5">
Nov 14 03:43:27 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:43:27 user nova-compute[74836]:         </nova:port>
Nov 14 03:43:27 user nova-compute[74836]:       </nova:ports>
Nov 14 03:43:27 user nova-compute[74836]:     </nova:instance>
Nov 14 03:43:27 user nova-compute[74836]:   </metadata>
Nov 14 03:43:27 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:43:27 user nova-compute[74836]:     <system>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="serial">8e7f7ece-9b05-4a83-925d-cc7fbbb5802b</entry>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="uuid">8e7f7ece-9b05-4a83-925d-cc7fbbb5802b</entry>
Nov 14 03:43:27 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:43:27 user nova-compute[74836]:     </system>
Nov 14 03:43:27 user nova-compute[74836]:   </sysinfo>
Nov 14 03:43:27 user nova-compute[74836]:   <os>
Nov 14 03:43:27 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:43:27 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:43:27 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:43:27 user nova-compute[74836]:   </os>
Nov 14 03:43:27 user nova-compute[74836]:   <features>
Nov 14 03:43:27 user nova-compute[74836]:     <acpi/>
Nov 14 03:43:27 user nova-compute[74836]:     <apic/>
Nov 14 03:43:27 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:43:27 user nova-compute[74836]:   </features>
Nov 14 03:43:27 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:43:27 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:43:27 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:43:27 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:43:27 user nova-compute[74836]:   </clock>
Nov 14 03:43:27 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:43:27 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:43:27 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:43:27 user nova-compute[74836]:   </cpu>
Nov 14 03:43:27 user nova-compute[74836]:   <devices>
Nov 14 03:43:27 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:43:27 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:43:27 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk"/>
Nov 14 03:43:27 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:43:27 user nova-compute[74836]:     </disk>
Nov 14 03:43:27 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:43:27 user nova-compute[74836]:       <mac address="fa:16:3e:bc:05:58"/>
Nov 14 03:43:27 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:27 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:43:27 user nova-compute[74836]:       <target dev="tap3f10538b-18"/>
Nov 14 03:43:27 user nova-compute[74836]:     </interface>
Nov 14 03:43:27 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:43:27 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/console.log" append="off"/>
Nov 14 03:43:27 user nova-compute[74836]:     </serial>
Nov 14 03:43:27 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:43:27 user nova-compute[74836]:     <video>
Nov 14 03:43:27 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:27 user nova-compute[74836]:     </video>
Nov 14 03:43:27 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:43:27 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:43:27 user nova-compute[74836]:     </rng>
Nov 14 03:43:27 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:43:27 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:43:27 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:43:27 user nova-compute[74836]:     </memballoon>
Nov 14 03:43:27 user nova-compute[74836]:   </devices>
Nov 14 03:43:27 user nova-compute[74836]: </domain>
Nov 14 03:43:27 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-685729348',display_name='tempest-TestStampPattern-server-685729348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-685729348',id=36,image_ref='f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-gwwxvmtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99',image_min_disk='1',image_min_ram='0',image_owner_id='66e650c0a29644dcbbb797a589e94729',image_owner_project_name='tempest-TestStampPattern-6640805',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-6640805-project-member',image_user_id='ed5afea1b58e4115957a8435f15ec95f',network_allocated='True',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:25Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=8e7f7ece-9b05-4a83-925d-cc7fbbb5802b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG os_vif [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe6cdda4-f1d3-5764-bad2-a0c570e8f14f', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f10538b-18, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f10538b-18, col_values=(('qos', UUID('d0192e0f-3521-4e39-8aa1-935ebe7b0300')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f10538b-18, col_values=(('external_ids', {'iface-id': '3f10538b-1826-413f-a37d-4f0238167af5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:05:58', 'vm-uuid': '8e7f7ece-9b05-4a83-925d-cc7fbbb5802b'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:27 user nova-compute[74836]: INFO os_vif [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18')
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No VIF found with MAC fa:16:3e:bc:05:58, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updated VIF entry in instance network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating instance_info_cache with network_info: [{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5f52c8-9bcd-4e06-9fe5-475da2e261b7 req-525e5524-e0d0-49c9-bf52-ef5a7e05de6e service nova] Releasing lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:43:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance spawned successfully.
Nov 14 03:43:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:28 user nova-compute[74836]: WARNING nova.compute.manager [req-e911f15e-f1a2-438a-9013-45c3dc20cd43 req-f9f983c4-0d52-42fe-ad91-dbc423b288f0 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:43:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9dc93317-4b79-47c5-8c60-8b2940d57479 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.712s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] No waiting events found dispatching network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:30 user nova-compute[74836]: WARNING nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received unexpected event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 for instance with vm_state building and task_state spawning.
Nov 14 03:43:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] No waiting events found dispatching network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:30 user nova-compute[74836]: WARNING nova.compute.manager [req-4d95dff6-20c2-42dd-b156-b053b1a9da80 req-2e42845b-60e8-48fe-b061-fe3f6d7f511d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received unexpected event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 for instance with vm_state building and task_state spawning.
Nov 14 03:43:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:43:31 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Instance spawned successfully.
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:31 user nova-compute[74836]: INFO nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 14 03:43:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:31 user nova-compute[74836]: INFO nova.compute.manager [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Took 6.72 seconds to build instance.
Nov 14 03:43:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f8ef05e4-6c68-4187-beb7-291bf85da1d7 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'flavor' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:34 user nova-compute[74836]: INFO nova.compute.manager [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attaching volume c8f47496-3c48-4c35-853b-13b71a27b66a to /dev/vdb
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafa914d-afa7-41f8-8ce4-2dc3a84f26ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3722afe3-e43d-48c3-83df-7bf5251a0eca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b5d619-4ab7-41d5-a824-174f900498f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[730bce85-e658-4096-be59-23cbc3866d1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:43:34 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[95696146-7d41-4323-81e4-94edbc344d6f]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating existing volume attachment record: c730a139-e129-42a1-99ac-a54bad0f175c {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:34 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:43:34 user nova-compute[74836]: INFO nova.compute.claims [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Claim successful on node user
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:43:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.policy [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd35f9323ce9c45509413703f3bc6c718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8df27ce98f4c4b3dbd2757da6dd61527', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:43:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Creating image(s)
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "/opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "/opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk 1073741824" returned: 0 in 0.067s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Successfully created port: bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.243s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Cannot resize image /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Ensure instance console log exists: /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Successfully updated port: bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquired lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-changed-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Refreshing instance network info cache due to event network-changed-bd12e82d-757d-4be9-b13e-7cb9ec3fe908. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] Acquiring lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Updating instance_info_cache with network_info: [{"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Releasing lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Instance network_info: |[{"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] Acquired lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Refreshing network info cache for port bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Start _get_guest_xml network_info=[{"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:43:37 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:37 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543804690',display_name='tempest-VolumesActionsTest-instance-543804690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543804690',id=37,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-eievdbid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:36Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=0b20ec3b-612a-4124-af35-fcf0c6f1c964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b20ec3b-612a-4124-af35-fcf0c6f1c964 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:43:37 user nova-compute[74836]:   <uuid>0b20ec3b-612a-4124-af35-fcf0c6f1c964</uuid>
Nov 14 03:43:37 user nova-compute[74836]:   <name>instance-00000025</name>
Nov 14 03:43:37 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:43:37 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:43:37 user nova-compute[74836]:   <metadata>
Nov 14 03:43:37 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:43:37 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:name>tempest-VolumesActionsTest-instance-543804690</nova:name>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:43:37</nova:creationTime>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:43:37 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:43:37 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:owner>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:user uuid="d35f9323ce9c45509413703f3bc6c718">tempest-VolumesActionsTest-883449369-project-member</nova:user>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:project uuid="8df27ce98f4c4b3dbd2757da6dd61527">tempest-VolumesActionsTest-883449369</nova:project>
Nov 14 03:43:37 user nova-compute[74836]:       </nova:owner>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:43:37 user nova-compute[74836]:       <nova:ports>
Nov 14 03:43:37 user nova-compute[74836]:         <nova:port uuid="bd12e82d-757d-4be9-b13e-7cb9ec3fe908">
Nov 14 03:43:37 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 03:43:37 user nova-compute[74836]:         </nova:port>
Nov 14 03:43:37 user nova-compute[74836]:       </nova:ports>
Nov 14 03:43:37 user nova-compute[74836]:     </nova:instance>
Nov 14 03:43:37 user nova-compute[74836]:   </metadata>
Nov 14 03:43:37 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:43:37 user nova-compute[74836]:     <system>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="serial">0b20ec3b-612a-4124-af35-fcf0c6f1c964</entry>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="uuid">0b20ec3b-612a-4124-af35-fcf0c6f1c964</entry>
Nov 14 03:43:37 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:43:37 user nova-compute[74836]:     </system>
Nov 14 03:43:37 user nova-compute[74836]:   </sysinfo>
Nov 14 03:43:37 user nova-compute[74836]:   <os>
Nov 14 03:43:37 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:43:37 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:43:37 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:43:37 user nova-compute[74836]:   </os>
Nov 14 03:43:37 user nova-compute[74836]:   <features>
Nov 14 03:43:37 user nova-compute[74836]:     <acpi/>
Nov 14 03:43:37 user nova-compute[74836]:     <apic/>
Nov 14 03:43:37 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:43:37 user nova-compute[74836]:   </features>
Nov 14 03:43:37 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:43:37 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:43:37 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:43:37 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:43:37 user nova-compute[74836]:   </clock>
Nov 14 03:43:37 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:43:37 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:43:37 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:43:37 user nova-compute[74836]:   </cpu>
Nov 14 03:43:37 user nova-compute[74836]:   <devices>
Nov 14 03:43:37 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:43:37 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:43:37 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk"/>
Nov 14 03:43:37 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:43:37 user nova-compute[74836]:     </disk>
Nov 14 03:43:37 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:43:37 user nova-compute[74836]:       <mac address="fa:16:3e:8f:2c:b4"/>
Nov 14 03:43:37 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:37 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:43:37 user nova-compute[74836]:       <target dev="tapbd12e82d-75"/>
Nov 14 03:43:37 user nova-compute[74836]:     </interface>
Nov 14 03:43:37 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:43:37 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/console.log" append="off"/>
Nov 14 03:43:37 user nova-compute[74836]:     </serial>
Nov 14 03:43:37 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:43:37 user nova-compute[74836]:     <video>
Nov 14 03:43:37 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:37 user nova-compute[74836]:     </video>
Nov 14 03:43:37 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:43:37 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:43:37 user nova-compute[74836]:     </rng>
Nov 14 03:43:37 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:43:37 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:43:37 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:43:37 user nova-compute[74836]:     </memballoon>
Nov 14 03:43:37 user nova-compute[74836]:   </devices>
Nov 14 03:43:37 user nova-compute[74836]: </domain>
Nov 14 03:43:37 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543804690',display_name='tempest-VolumesActionsTest-instance-543804690',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543804690',id=37,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-eievdbid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:43:36Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=0b20ec3b-612a-4124-af35-fcf0c6f1c964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG os_vif [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a561ddf1-341d-531a-b431-49dbde904db6', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd12e82d-75, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd12e82d-75, col_values=(('qos', UUID('3545d109-217d-47d6-afcc-f230f08af36d')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd12e82d-75, col_values=(('external_ids', {'iface-id': 'bd12e82d-757d-4be9-b13e-7cb9ec3fe908', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:2c:b4', 'vm-uuid': '0b20ec3b-612a-4124-af35-fcf0c6f1c964'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:37 user nova-compute[74836]: INFO os_vif [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75')
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] No VIF found with MAC fa:16:3e:8f:2c:b4, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Updated VIF entry in instance network info cache for port bd12e82d-757d-4be9-b13e-7cb9ec3fe908. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Updating instance_info_cache with network_info: [{"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0c0a9651-b9eb-40c8-9204-0262607ac1ad req-515fcdc2-bf9f-4670-83cc-6fd3fca14fab service nova] Releasing lock "refresh_cache-0b20ec3b-612a-4124-af35-fcf0c6f1c964" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] No waiting events found dispatching network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:39 user nova-compute[74836]: WARNING nova.compute.manager [req-4f3f7e4a-25e2-4e3e-b470-50d524ad6d69 req-8be7f843-b410-449e-a58c-91e1bb5b558c service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received unexpected event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 for instance with vm_state building and task_state spawning.
Nov 14 03:43:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:39 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4808c3-df03-48c2-815b-94210fc95d92]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:43:39 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e0a5bd-d8d9-499d-9964-f1a47ecaa4db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a] added
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc166a0-fd1e-452d-a578-54ea6c46835a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b1025-919b-4d38-b8cd-4e4ab21486a6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivSlUHEk {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivSlUHEk" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e39a53-1037-492e-b452-a61210c22c9a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivSlUHEk'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a214992-5a2b-423e-9543-867c281c3182]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e8dfb-a423-4832-ae2b-0838130fa15c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e8734-41d7-456d-86e9-8a7d2722c1cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260]
Nov 14 03:43:39 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260] successful.
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[221e811b-a46a-43c8-8b9c-7a0dca9ecb2f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79050e57-15c9-4b75-8759-ff0fec5c5417]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:39 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:43:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:43:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102f727-5758-4358-afbc-b82f478df816]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:43:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:43:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26231336631316533', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231336631316533', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'flavor' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:43:41 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:43:41 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:43:41 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:43:41 user nova-compute[74836]:   <serial>c8f47496-3c48-4c35-853b-13b71a27b66a</serial>
Nov 14 03:43:41 user nova-compute[74836]: </disk>
Nov 14 03:43:41 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] No waiting events found dispatching network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:41 user nova-compute[74836]: WARNING nova.compute.manager [req-e91d9c35-c98a-4b6b-bba8-d3cade2d721d req-ead00c5c-1fb2-40c9-9751-33ed1ee5b2e5 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received unexpected event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 for instance with vm_state building and task_state spawning.
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:43:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Instance spawned successfully.
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:43:41 user nova-compute[74836]: INFO nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No VIF found with MAC fa:16:3e:07:fb:b9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:41 user nova-compute[74836]: INFO nova.compute.manager [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Took 6.96 seconds to build instance.
Nov 14 03:43:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a386473f-4eff-4a77-9b2a-24513335f419 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5163d68d-bfb9-4ff5-924b-d6cb217f6cee tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.776s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:43 user nova-compute[74836]: INFO nova.compute.manager [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Rescuing
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:43 user nova-compute[74836]: INFO nova.compute.manager [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Terminating instance
Nov 14 03:43:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-unplugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] No waiting events found dispatching network-vif-unplugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-ce367aa9-7c08-4c10-bb23-f10f8edc2625 req-025b88b6-dec7-4c8b-95ca-2c7e1e2b511b service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-unplugged-577288cf-f023-405b-b9a8-157328ce73a5 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Instance destroyed successfully.
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.objects.instance [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'resources' on Instance uuid 852a825d-62a4-4a54-80a9-f62312bca2d6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:38:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1751577144',display_name='tempest-AttachVolumeNegativeTest-server-1751577144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1751577144',id=24,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+rlEa5uGxEqOIByAbFzq19w0eFekJVqVVvY7zzDv7Hs16TwBQmkOepyJHHPuTrHecqMhfoBHjHmF4MN7b4oqYlHES5om9rnzHhiKDz50+kc9DlgxukPa4BMPzl8wItiA==',key_name='tempest-keypair-393190380',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:38:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-zjh01f06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:38:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=852a825d-62a4-4a54-80a9-f62312bca2d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "577288cf-f023-405b-b9a8-157328ce73a5", "address": "fa:16:3e:30:69:86", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap577288cf-f0", "ovs_interfaceid": "577288cf-f023-405b-b9a8-157328ce73a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG os_vif [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap577288cf-f0, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92da556a-2c0b-4f9d-89c8-beafe051b244) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:44 user nova-compute[74836]: INFO os_vif [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:69:86,bridge_name='br-int',has_traffic_filtering=True,id=577288cf-f023-405b-b9a8-157328ce73a5,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap577288cf-f0')
Nov 14 03:43:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Deleting instance files /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6_del
Nov 14 03:43:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Deletion of /opt/stack/data/nova/instances/852a825d-62a4-4a54-80a9-f62312bca2d6_del complete
Nov 14 03:43:44 user nova-compute[74836]: INFO nova.compute.manager [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:44 user nova-compute[74836]: WARNING nova.compute.manager [req-8fd0b040-3600-495d-ac9c-6f0aa76a8fe0 req-7d794cae-3b0a-4da5-8905-17ec23cdae31 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state active and task_state rescuing.
Nov 14 03:43:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance destroyed successfully.
Nov 14 03:43:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attempting a stable device rescue
Nov 14 03:43:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:43:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Creating image(s)
Nov 14 03:43:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:45 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:43:45 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Took 0.80 seconds to deallocate network for instance.
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] Acquiring lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] No waiting events found dispatching network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:46 user nova-compute[74836]: WARNING nova.compute.manager [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received unexpected event network-vif-plugged-577288cf-f023-405b-b9a8-157328ce73a5 for instance with vm_state deleted and task_state None.
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-03719433-e73d-410e-ae27-095894a1f440 req-b5fb8e16-2e63-4296-b420-837a22826a8c service nova] [instance: 852a825d-62a4-4a54-80a9-f62312bca2d6] Received event network-vif-deleted-577288cf-f023-405b-b9a8-157328ce73a5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.virt.images [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] 1a39a437-2a10-498a-b6d2-f287d9630dd6 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.part /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:46 user nova-compute[74836]: WARNING nova.compute.manager [req-36277f2b-950d-47d8-b565-50b0824f0a09 req-ecb621b8-4da9-42d0-85b6-15f5eb3ad882 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state active and task_state rescuing.
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.part /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.converted" returned: 0 in 0.308s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.799s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.803s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:47 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Deleted allocations for instance 852a825d-62a4-4a54-80a9-f62312bca2d6
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221 --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221,backing_fmt=raw /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221,backing_fmt=raw /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue" returned: 0 in 0.056s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'migration_context' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Object Instance<8c388b9c-02bb-4831-9978-9101b4050288> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start _get_guest_xml network_info=[{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "vif_mac": "fa:16:3e:07:fb:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1a39a437-2a10-498a-b6d2-f287d9630dd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '8c388b9c-02bb-4831-9978-9101b4050288', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8f47496-3c48-4c35-853b-13b71a27b66a', 'serial': 'c8f47496-3c48-4c35-853b-13b71a27b66a'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': 'c730a139-e129-42a1-99ac-a54bad0f175c', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'resources' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Object Instance<8c388b9c-02bb-4831-9978-9101b4050288> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-af243502-022c-49ea-b332-ad59952f314a tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "852a825d-62a4-4a54-80a9-f62312bca2d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.814s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Object Instance<8c388b9c-02bb-4831-9978-9101b4050288> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:47 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:47 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Object Instance<8c388b9c-02bb-4831-9978-9101b4050288> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:43:47 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:47 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:43:47 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f5a21-1610-482e-922c-3e6b57854e39]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ivSlUHEk\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 03:43:47 user nova-compute[74836]: node.name = iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:43:47 user nova-compute[74836]: node.tpgt = -1
Nov 14 03:43:47 user nova-compute[74836]: node.startup = automatic
Nov 14 03:43:47 user nova-compute[74836]: node.leading_login = No
Nov 14 03:43:47 user nova-compute[74836]: iface.iscsi_ifacename = default
Nov 14 03:43:47 user nova-compute[74836]: iface.net_ifacename = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.ipaddress = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.prefix_len = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.hwaddress = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.transport_name = tcp
Nov 14 03:43:47 user nova-compute[74836]: iface.initiatorname = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.vlan_id = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.vlan_priority = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.vlan_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.iface_num = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.mtu = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.port = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.bootproto = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.subnet_mask = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.gateway = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_alt_client_id = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_dns = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_learn_iqn = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_vendor_id_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_vendor_id = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.dhcp_slp_da = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.fragmentation = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.gratuitous_arp = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.incoming_forwarding = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.tos_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.tos = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.ttl = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.delayed_ack = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.tcp_nagle = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.tcp_wsf_state = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.tcp_wsf = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.tcp_timer_scale = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.tcp_timestamp = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.redirect = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.def_task_mgmt_timeout = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.header_digest = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.data_digest = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.immediate_data = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.initial_r2t = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.data_seq_inorder = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.data_pdu_inorder = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.erl = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.max_receive_data_len = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.first_burst_len = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.max_outstanding_r2t = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.max_burst_len = 0
Nov 14 03:43:47 user nova-compute[74836]: iface.chap_auth = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.bidi_chap = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.strict_login_compliance = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.discovery_auth = <empty>
Nov 14 03:43:47 user nova-compute[74836]: iface.discovery_logout = <empty>
Nov 14 03:43:47 user nova-compute[74836]: node.discovery_address = <empty>
Nov 14 03:43:47 user nova-compute[74836]: node.discovery_port = 0
Nov 14 03:43:47 user nova-compute[74836]: node.discovery_type = static
Nov 14 03:43:47 user nova-compute[74836]: node.session.initial_cmdsn = 0
Nov 14 03:43:47 user nova-compute[74836]: node.session.initial_login_retry_max = 8
Nov 14 03:43:47 user nova-compute[74836]: node.session.xmit_thread_priority = -20
Nov 14 03:43:47 user nova-compute[74836]: node.session.cmds_max = 128
Nov 14 03:43:47 user nova-compute[74836]: node.session.queue_depth = 32
Nov 14 03:43:47 user nova-compute[74836]: node.session.nr_sessions = 1
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.authmethod = CHAP
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.username = ivSlUHEk
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.password = ***
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.username_in = <empty>
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.password_in = <empty>
Nov 14 03:43:47 user nova-compute[74836]: node.session.auth.chap_algs = MD5
Nov 14 03:43:47 user nova-compute[74836]: node.session.timeo.replacement_timeout = 120
Nov 14 03:43:47 user nova-compute[74836]: node.session.err_timeo.abort_timeout = 15
Nov 14 03:43:47 user nova-compute[74836]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 03:43:47 user nova-compute[74836]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 03:43:47 user nova-compute[74836]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.FastAbort = Yes
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.InitialR2T = No
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.ImmediateData = Yes
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.MaxConnections = 1
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 03:43:47 user nova-compute[74836]: node.session.iscsi.ERL = 0
Nov 14 03:43:47 user nova-compute[74836]: node.session.scan = manual
Nov 14 03:43:47 user nova-compute[74836]: node.session.reopen_max = 0
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].address = 172.16.0.220
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].port = 3260
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].startup = manual
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].tcp.window_size = 524288
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].tcp.type_of_service = 0
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].timeo.logout_timeout = 15
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].timeo.login_timeout = 15
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].timeo.auth_timeout = 45
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.DataDigest = None
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.IFMarker = No
Nov 14 03:43:47 user nova-compute[74836]: node.conn[0].iscsi.OFMarker = No
Nov 14 03:43:47 user nova-compute[74836]: # END RECORD
Nov 14 03:43:47 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cfceb3-47b7-4659-82d4-e4ca05127558]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabdd0a1-dc5a-4452-8766-2a4235c0b2ab]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivSlUHEk {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ivSlUHEk" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[37964994-bf52-4b38-ab84-8b45eab9313f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ivSlUHEk'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebe5cc-54a8-48a9-bb9f-4c34139cb459]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d55ba-3d85-4515-8a7f-e48e0195ae5a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:43:47 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:43:47 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:43:47 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] HCTL ('36', '0', '0', 0) found on session 39 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d442a8-739b-4e46-9d73-b0552899ff75]: (4, ('0 0 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Searching for a device in session 39 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '26231336631316533', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231336631316533', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-95912381',display_name='tempest-ServerStableDeviceRescueTest-server-95912381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-95912381',id=29,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUulbrK4M6ry0RgtySgnTgsd/I8t2nBB2ZXRuZgTHZyaTBj1FI9b2srpNwrPgxGnLmCgmWANqcDoONraM6yJ3nyCggdfbNUYCw9DFdm3b9ZCMD/uvUqUp+mEAd4lk4xZw==',key_name='tempest-keypair-982684915',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd43e6daeb32480a83a53334ddf46567',ramdisk_id='',reservation_id='r-lfr817sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-996871557',owner_user_name='tempest-ServerStableDeviceRescueTest-996871557-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16e5d6e474e54299a2cbe8094a46d896',uuid=8c388b9c-02bb-4831-9978-9101b4050288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "vif_mac": "fa:16:3e:07:fb:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converting VIF {"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "vif_mac": "fa:16:3e:07:fb:b9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Object Instance<8c388b9c-02bb-4831-9978-9101b4050288> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:43:47 user nova-compute[74836]:   <uuid>8c388b9c-02bb-4831-9978-9101b4050288</uuid>
Nov 14 03:43:47 user nova-compute[74836]:   <name>instance-0000001d</name>
Nov 14 03:43:47 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:43:47 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:43:47 user nova-compute[74836]:   <metadata>
Nov 14 03:43:47 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:43:47 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-95912381</nova:name>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:43:47</nova:creationTime>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:43:47 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:43:47 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:owner>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:user uuid="16e5d6e474e54299a2cbe8094a46d896">tempest-ServerStableDeviceRescueTest-996871557-project-member</nova:user>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:project uuid="bd43e6daeb32480a83a53334ddf46567">tempest-ServerStableDeviceRescueTest-996871557</nova:project>
Nov 14 03:43:47 user nova-compute[74836]:       </nova:owner>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:43:47 user nova-compute[74836]:       <nova:ports>
Nov 14 03:43:47 user nova-compute[74836]:         <nova:port uuid="a4f70871-618b-47a0-a1a3-cba1cd7e806a">
Nov 14 03:43:47 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:43:47 user nova-compute[74836]:         </nova:port>
Nov 14 03:43:47 user nova-compute[74836]:       </nova:ports>
Nov 14 03:43:47 user nova-compute[74836]:     </nova:instance>
Nov 14 03:43:47 user nova-compute[74836]:   </metadata>
Nov 14 03:43:47 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:43:47 user nova-compute[74836]:     <system>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="serial">8c388b9c-02bb-4831-9978-9101b4050288</entry>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="uuid">8c388b9c-02bb-4831-9978-9101b4050288</entry>
Nov 14 03:43:47 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:43:47 user nova-compute[74836]:     </system>
Nov 14 03:43:47 user nova-compute[74836]:   </sysinfo>
Nov 14 03:43:47 user nova-compute[74836]:   <os>
Nov 14 03:43:47 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:43:47 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:43:47 user nova-compute[74836]:   </os>
Nov 14 03:43:47 user nova-compute[74836]:   <features>
Nov 14 03:43:47 user nova-compute[74836]:     <acpi/>
Nov 14 03:43:47 user nova-compute[74836]:     <apic/>
Nov 14 03:43:47 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:43:47 user nova-compute[74836]:   </features>
Nov 14 03:43:47 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:43:47 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:43:47 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:43:47 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:43:47 user nova-compute[74836]:   </clock>
Nov 14 03:43:47 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:43:47 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:43:47 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:43:47 user nova-compute[74836]:   </cpu>
Nov 14 03:43:47 user nova-compute[74836]:   <devices>
Nov 14 03:43:47 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:43:47 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:43:47 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk"/>
Nov 14 03:43:47 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:43:47 user nova-compute[74836]:     </disk>
Nov 14 03:43:47 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:43:47 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:43:47 user nova-compute[74836]:       <source dev="/dev/sde"/>
Nov 14 03:43:47 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:43:47 user nova-compute[74836]:       <serial>c8f47496-3c48-4c35-853b-13b71a27b66a</serial>
Nov 14 03:43:47 user nova-compute[74836]:     </disk>
Nov 14 03:43:47 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:43:47 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:43:47 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue"/>
Nov 14 03:43:47 user nova-compute[74836]:       <target dev="vdc" bus="virtio"/>
Nov 14 03:43:47 user nova-compute[74836]:       <boot order="1"/>
Nov 14 03:43:47 user nova-compute[74836]:     </disk>
Nov 14 03:43:47 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:43:47 user nova-compute[74836]:       <mac address="fa:16:3e:07:fb:b9"/>
Nov 14 03:43:47 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:47 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:43:47 user nova-compute[74836]:       <target dev="tapa4f70871-61"/>
Nov 14 03:43:47 user nova-compute[74836]:     </interface>
Nov 14 03:43:47 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:43:47 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/console.log" append="off"/>
Nov 14 03:43:47 user nova-compute[74836]:     </serial>
Nov 14 03:43:47 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:43:47 user nova-compute[74836]:     <video>
Nov 14 03:43:47 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:43:47 user nova-compute[74836]:     </video>
Nov 14 03:43:47 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:43:47 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:43:47 user nova-compute[74836]:     </rng>
Nov 14 03:43:47 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:43:47 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:43:47 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:43:47 user nova-compute[74836]:     </memballoon>
Nov 14 03:43:47 user nova-compute[74836]:   </devices>
Nov 14 03:43:47 user nova-compute[74836]: </domain>
Nov 14 03:43:47 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:43:47 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance destroyed successfully.
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:43:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] No VIF found with MAC fa:16:3e:07:fb:b9, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG nova.compute.manager [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG nova.compute.manager [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:49 user nova-compute[74836]: WARNING nova.compute.manager [req-82788f68-07f4-4456-88f1-bb513f6ce270 req-b0e98a13-9edd-4edd-8a4c-36b9c6c80818 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state active and task_state rescuing.
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-73b504f4-6a95-4744-bb42-ad751a64f0d3 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:43:51 user nova-compute[74836]: WARNING nova.compute.manager [req-92cbc368-7f9a-45ae-bc72-d4107303d691 req-f458cf14-c100-4876-9f84-ab3a626ea7f0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state rescued and task_state None.
Nov 14 03:43:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:43:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:43:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:43:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:01 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:01 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6926MB free_disk=24.708091735839844GB free_vcpus=-3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 974f1e28-ceff-4235-99d5-0c3e34273482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0b20ec3b-612a-4124-af35-fcf0c6f1c964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:44:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-changed-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Refreshing instance network info cache due to event network-changed-b549e8cc-909f-4450-9b90-afd13379e321. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG nova.network.neutron [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Refreshing network info cache for port b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updated VIF entry in instance network info cache for port b549e8cc-909f-4450-9b90-afd13379e321. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:44:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0e528176-fa0b-45ea-bc58-5b1910fbd971 req-cc12ed5f-23db-4197-859c-0dc3b3c93fdd service nova] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:08 user nova-compute[74836]: INFO nova.compute.manager [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Rescuing
Nov 14 03:44:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating instance_info_cache with network_info: [{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:09 user nova-compute[74836]: WARNING nova.compute.manager [req-3c89e105-52b7-4843-b8cc-7a0634cfc6aa req-943da4b9-73cb-4726-ba35-09a885c4b7f3 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state active and task_state rescuing.
Nov 14 03:44:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance destroyed successfully.
Nov 14 03:44:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Attempting a stable device rescue
Nov 14 03:44:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74836) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:44:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Creating image(s)
Nov 14 03:44:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'trusted_certs' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "abee98cc3d056326eebcbb8e739030b430a42145" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "abee98cc3d056326eebcbb8e739030b430a42145" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG nova.virt.images [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] 0b85d24c-9a6a-413c-9400-b1c47cde1b26 was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.part /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.part /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.converted" returned: 0 in 0.265s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:11 user nova-compute[74836]: WARNING nova.compute.manager [req-48dca2bc-6325-438f-960d-6af32c0181a8 req-097ead9c-2c60-4702-9975-c8b501823d0f service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state active and task_state rescuing.
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "abee98cc3d056326eebcbb8e739030b430a42145" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.655s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "abee98cc3d056326eebcbb8e739030b430a42145" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "abee98cc3d056326eebcbb8e739030b430a42145" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145 --force-share --output=json" returned: 0 in 0.164s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:11 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145,backing_fmt=raw /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145,backing_fmt=raw /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue" returned: 0 in 0.239s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "abee98cc3d056326eebcbb8e739030b430a42145" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.413s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'migration_context' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<974f1e28-ceff-4235-99d5-0c3e34273482> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start _get_guest_xml network_info=[{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:39:2b:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0b85d24c-9a6a-413c-9400-b1c47cde1b26', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '974f1e28-ceff-4235-99d5-0c3e34273482', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf3973b6-e973-47e1-b8a0-d552af152c23', 'serial': 'bf3973b6-e973-47e1-b8a0-d552af152c23'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8cc0544e-5ca6-46ac-92eb-28cccf676e3c', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<974f1e28-ceff-4235-99d5-0c3e34273482> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'numa_topology' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<974f1e28-ceff-4235-99d5-0c3e34273482> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:44:12 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:12 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'vcpu_model' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<974f1e28-ceff-4235-99d5-0c3e34273482> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:44:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:44:12 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:44:12 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cacd02-dc7f-43b0-9f6e-b4dbbec34c19]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xgRVvlTC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 03:44:12 user nova-compute[74836]: node.name = iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:44:12 user nova-compute[74836]: node.tpgt = -1
Nov 14 03:44:12 user nova-compute[74836]: node.startup = automatic
Nov 14 03:44:12 user nova-compute[74836]: node.leading_login = No
Nov 14 03:44:12 user nova-compute[74836]: iface.iscsi_ifacename = default
Nov 14 03:44:12 user nova-compute[74836]: iface.net_ifacename = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.ipaddress = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.prefix_len = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.hwaddress = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.transport_name = tcp
Nov 14 03:44:12 user nova-compute[74836]: iface.initiatorname = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.vlan_id = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.vlan_priority = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.vlan_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.iface_num = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.mtu = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.port = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.bootproto = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.subnet_mask = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.gateway = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_alt_client_id = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_dns = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_learn_iqn = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_vendor_id_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_vendor_id = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.dhcp_slp_da = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.fragmentation = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.gratuitous_arp = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.incoming_forwarding = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.tos_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.tos = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.ttl = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.delayed_ack = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.tcp_nagle = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.tcp_wsf_state = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.tcp_wsf = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.tcp_timer_scale = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.tcp_timestamp = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.redirect = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.def_task_mgmt_timeout = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.header_digest = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.data_digest = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.immediate_data = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.initial_r2t = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.data_seq_inorder = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.data_pdu_inorder = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.erl = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.max_receive_data_len = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.first_burst_len = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.max_outstanding_r2t = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.max_burst_len = 0
Nov 14 03:44:12 user nova-compute[74836]: iface.chap_auth = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.bidi_chap = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.strict_login_compliance = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.discovery_auth = <empty>
Nov 14 03:44:12 user nova-compute[74836]: iface.discovery_logout = <empty>
Nov 14 03:44:12 user nova-compute[74836]: node.discovery_address = <empty>
Nov 14 03:44:12 user nova-compute[74836]: node.discovery_port = 0
Nov 14 03:44:12 user nova-compute[74836]: node.discovery_type = static
Nov 14 03:44:12 user nova-compute[74836]: node.session.initial_cmdsn = 0
Nov 14 03:44:12 user nova-compute[74836]: node.session.initial_login_retry_max = 8
Nov 14 03:44:12 user nova-compute[74836]: node.session.xmit_thread_priority = -20
Nov 14 03:44:12 user nova-compute[74836]: node.session.cmds_max = 128
Nov 14 03:44:12 user nova-compute[74836]: node.session.queue_depth = 32
Nov 14 03:44:12 user nova-compute[74836]: node.session.nr_sessions = 1
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.authmethod = CHAP
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.username = xgRVvlTC
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.password = ***
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.username_in = <empty>
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.password_in = <empty>
Nov 14 03:44:12 user nova-compute[74836]: node.session.auth.chap_algs = MD5
Nov 14 03:44:12 user nova-compute[74836]: node.session.timeo.replacement_timeout = 120
Nov 14 03:44:12 user nova-compute[74836]: node.session.err_timeo.abort_timeout = 15
Nov 14 03:44:12 user nova-compute[74836]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 03:44:12 user nova-compute[74836]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 03:44:12 user nova-compute[74836]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.FastAbort = Yes
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.InitialR2T = No
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.ImmediateData = Yes
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.MaxConnections = 1
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 03:44:12 user nova-compute[74836]: node.session.iscsi.ERL = 0
Nov 14 03:44:12 user nova-compute[74836]: node.session.scan = manual
Nov 14 03:44:12 user nova-compute[74836]: node.session.reopen_max = 0
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].address = 172.16.0.220
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].port = 3260
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].startup = manual
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].tcp.window_size = 524288
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].tcp.type_of_service = 0
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].timeo.logout_timeout = 15
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].timeo.login_timeout = 15
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].timeo.auth_timeout = 45
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.DataDigest = None
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.IFMarker = No
Nov 14 03:44:12 user nova-compute[74836]: node.conn[0].iscsi.OFMarker = No
Nov 14 03:44:12 user nova-compute[74836]: # END RECORD
Nov 14 03:44:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498ac69-47c4-43a2-ad29-f50f348a6b11]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1f943-0826-4b7e-b7f5-5b0b258c7099]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgRVvlTC {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgRVvlTC" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8a020c-9ed1-4907-9ad8-b8302d772fa7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgRVvlTC'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8cc049-1f53-4a3a-9990-02d04a4a1124]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[737edf09-3490-4840-9f7e-0f16235e5a1f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:12 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:12 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[828877a0-cbe8-4b7c-af10-fb3c7860df12]: (4, ('0 0 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== connect_volume: return (191ms) {'type': 'block', 'scsi_wwn': '23039346438613834', 'path': '/dev/sdf'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039346438613834', 'path': '/dev/sdf'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839081279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839081279',id=34,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-6g2mx4wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:42:38Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=974f1e28-ceff-4235-99d5-0c3e34273482,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:39:2b:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "vif_mac": "fa:16:3e:39:2b:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'pci_devices' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.objects.base [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Object Instance<974f1e28-ceff-4235-99d5-0c3e34273482> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:44:12 user nova-compute[74836]:   <uuid>974f1e28-ceff-4235-99d5-0c3e34273482</uuid>
Nov 14 03:44:12 user nova-compute[74836]:   <name>instance-00000022</name>
Nov 14 03:44:12 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:44:12 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:44:12 user nova-compute[74836]:   <metadata>
Nov 14 03:44:12 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:44:12 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1839081279</nova:name>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:44:12</nova:creationTime>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:44:12 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:44:12 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:owner>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:user uuid="7107bdffb0544dd890311071f04662ce">tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member</nova:user>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:project uuid="9353de76529e464c82aa0d303b797362">tempest-ServerBootFromVolumeStableRescueTest-273181148</nova:project>
Nov 14 03:44:12 user nova-compute[74836]:       </nova:owner>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:44:12 user nova-compute[74836]:       <nova:ports>
Nov 14 03:44:12 user nova-compute[74836]:         <nova:port uuid="2294d5c3-da92-4af3-bc08-654e34b222e8">
Nov 14 03:44:12 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:44:12 user nova-compute[74836]:         </nova:port>
Nov 14 03:44:12 user nova-compute[74836]:       </nova:ports>
Nov 14 03:44:12 user nova-compute[74836]:     </nova:instance>
Nov 14 03:44:12 user nova-compute[74836]:   </metadata>
Nov 14 03:44:12 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:44:12 user nova-compute[74836]:     <system>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="serial">974f1e28-ceff-4235-99d5-0c3e34273482</entry>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="uuid">974f1e28-ceff-4235-99d5-0c3e34273482</entry>
Nov 14 03:44:12 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:44:12 user nova-compute[74836]:     </system>
Nov 14 03:44:12 user nova-compute[74836]:   </sysinfo>
Nov 14 03:44:12 user nova-compute[74836]:   <os>
Nov 14 03:44:12 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:44:12 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:44:12 user nova-compute[74836]:   </os>
Nov 14 03:44:12 user nova-compute[74836]:   <features>
Nov 14 03:44:12 user nova-compute[74836]:     <acpi/>
Nov 14 03:44:12 user nova-compute[74836]:     <apic/>
Nov 14 03:44:12 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:44:12 user nova-compute[74836]:   </features>
Nov 14 03:44:12 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:44:12 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:44:12 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:44:12 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:44:12 user nova-compute[74836]:   </clock>
Nov 14 03:44:12 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:44:12 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:44:12 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:44:12 user nova-compute[74836]:   </cpu>
Nov 14 03:44:12 user nova-compute[74836]:   <devices>
Nov 14 03:44:12 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:44:12 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:44:12 user nova-compute[74836]:       <source dev="/dev/sdf"/>
Nov 14 03:44:12 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:44:12 user nova-compute[74836]:       <serial>bf3973b6-e973-47e1-b8a0-d552af152c23</serial>
Nov 14 03:44:12 user nova-compute[74836]:     </disk>
Nov 14 03:44:12 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:44:12 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:44:12 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue"/>
Nov 14 03:44:12 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:44:12 user nova-compute[74836]:       <boot order="1"/>
Nov 14 03:44:12 user nova-compute[74836]:     </disk>
Nov 14 03:44:12 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:44:12 user nova-compute[74836]:       <mac address="fa:16:3e:39:2b:e2"/>
Nov 14 03:44:12 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:12 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:44:12 user nova-compute[74836]:       <target dev="tap2294d5c3-da"/>
Nov 14 03:44:12 user nova-compute[74836]:     </interface>
Nov 14 03:44:12 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:44:12 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/console.log" append="off"/>
Nov 14 03:44:12 user nova-compute[74836]:     </serial>
Nov 14 03:44:12 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:44:12 user nova-compute[74836]:     <video>
Nov 14 03:44:12 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:12 user nova-compute[74836]:     </video>
Nov 14 03:44:12 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:44:12 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:44:12 user nova-compute[74836]:     </rng>
Nov 14 03:44:12 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:44:12 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:44:12 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:44:12 user nova-compute[74836]:     </memballoon>
Nov 14 03:44:12 user nova-compute[74836]:   </devices>
Nov 14 03:44:12 user nova-compute[74836]: </domain>
Nov 14 03:44:12 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:44:12 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance destroyed successfully.
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:44:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] No VIF found with MAC fa:16:3e:39:2b:e2, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing instance network info cache due to event network-changed-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Refreshing network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Stashing vm_state: active {{(pid=74836) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:44:14 user nova-compute[74836]: INFO nova.compute.claims [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Claim successful on node user
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated VIF entry in instance network info cache for port a59ca6c0-1a41-4d14-9de7-f56d96dcee3b. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-changed-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Refreshing instance network info cache due to event network-changed-bbefd00c-ed80-4225-b8a2-fb748de8ff46. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Refreshing network info cache for port bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:14 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating resource usage from migration 51d981bf-895f-44eb-81ee-5447a6c2aca9
Nov 14 03:44:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updated VIF entry in instance network info cache for port bbefd00c-ed80-4225-b8a2-fb748de8ff46. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cf730118-35d3-44ba-b857-90a7224713fb req-574a6f44-0071-4bc0-9196-f16294ea5a64 service nova] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.643s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:14 user nova-compute[74836]: INFO nova.compute.manager [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Migrating
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:14 user nova-compute[74836]: INFO nova.compute.rpcapi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Starting migrate_disk_and_power_off {{(pid=74836) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:15 user nova-compute[74836]: WARNING nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state active and task_state rescuing.
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:15 user nova-compute[74836]: WARNING nova.compute.manager [req-b01841c1-573e-499c-b3f1-ec5e0f721b24 req-17d07ed5-f301-4b4d-880f-2b920bf45ac0 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state active and task_state rescuing.
Nov 14 03:44:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance destroyed successfully.
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:44:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbefd00c-ed, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4522f777-19c3-45b1-af6d-8c4a8e5e7108) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:16 user nova-compute[74836]: INFO os_vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed')
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:44:16 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36bccc-bf2a-4fba-b40a-d3024fce23d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:44:16 user nova-compute[74836]: No targets found.
Nov 14 03:44:16 user nova-compute[74836]: iSNS:
Nov 14 03:44:16 user nova-compute[74836]: No targets found.
Nov 14 03:44:16 user nova-compute[74836]: STATIC:
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:44:16 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:44:16 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:44:16 user nova-compute[74836]: FIRMWARE:
Nov 14 03:44:16 user nova-compute[74836]: No targets found.
Nov 14 03:44:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:44:16 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:44:16 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff75e368-2d91-4cc9-959b-9bf82cc235f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93d297a-1316-42fe-af2c-47d95ccf1bd0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:16 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44adcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa'): ({'sdg'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Removing single pathed devices sdg {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-81c51c63-0274-479a-b643-425b971ba10c tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b02f8c-3c3e-44f5-959f-817a570b5f72]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af990bc-adcf-4b06-9d70-f1cb23e6a7fc]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flushing IO for device /dev/sdg {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adf531f-5881-450e-9905-d0b3747cf1b6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.077s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[093cb3e8-a93b-402b-a6d0-48eb22c09c80]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[697bfda9-a856-4a0f-9f30-c999c644338b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[48113299-6193-4fd5-b046-165b5fd8ffa4]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]
Nov 14 03:44:16 user nova-compute[74836]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.
Nov 14 03:44:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3613b2-d668-4d16-9547-c33b3b34a68c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== disconnect_volume: return (384ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:44:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Port bbefd00c-ed80-4225-b8a2-fb748de8ff46 binding to destination host user is already ACTIVE {{(pid=74836) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:17 user nova-compute[74836]: WARNING nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state active and task_state resize_migrating.
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:17 user nova-compute[74836]: WARNING nova.compute.manager [req-69ceaae7-d545-456d-8a6f-96ab20f0220f req-26dcff46-6091-49ad-8e2e-f57756b05ed3 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state active and task_state resize_migrating.
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG nova.network.neutron [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.utils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b99d1e-e5fa-4030-a983-fb087d8de893]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed86e30-e180-4116-8acd-9fa9752c3d90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e807b2-5d2f-46d9-9b95-f5845c291337]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c685c-d971-4549-a8f3-7f385bade1a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:44:18 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:44:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c59a3d5-aad7-4cd1-86a7-b1ed27ac43b9]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:44:18 user nova-compute[74836]: DEBUG os_brick.utils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:44:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Starting finish_migration {{(pid=74836) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:44:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Creating image(s)
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Ensure instance console log exists: /opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start _get_guest_xml network_info=[{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7ef95a37-bfa0-4af9-9ed8-993af09116f6', 'attached_at': '2023-11-14T03:44:23.000000', 'detached_at': '', 'volume_id': '3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'serial': '3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '7107a5bc-ec98-4a25-879d-80c461bc2d32', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:44:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:44:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:44:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:44:23 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2774ca-6fbe-4387-8044-72957d423ccc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:44:23 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[042f8a2d-212b-4d03-b040-904b4a672631]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa] added
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2b209-dce9-4eb5-acf4-c9b5beca2a97]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[068be2e4-504e-403a-8a41-ea53e6a660f6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNSDozwl {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jNSDozwl" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[12452d21-527d-493d-a0a6-772d7847da52]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jNSDozwl'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b153e34-fc17-40eb-ad16-f4336c8ed480]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a3c74-ea68-4986-ba30-6a57d365f424]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a86ea99-6640-4065-98ed-7f5471c1e922]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]
Nov 14 03:44:23 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fbe0d7-995c-455a-a8b5-47309732848c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0256a2-2fca-479b-b1a9-af12927e34c2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:44:23 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:44:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97aa146-1542-45ce-ba6f-8fb7b98fb25b]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:44:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26139336230343565', 'path': '/dev/sdg'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139336230343565', 'path': '/dev/sdg'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:44:24 user nova-compute[74836]:   <uuid>7ef95a37-bfa0-4af9-9ed8-993af09116f6</uuid>
Nov 14 03:44:24 user nova-compute[74836]:   <name>instance-00000023</name>
Nov 14 03:44:24 user nova-compute[74836]:   <memory>2097152</memory>
Nov 14 03:44:24 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:44:24 user nova-compute[74836]:   <metadata>
Nov 14 03:44:24 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:44:24 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:44:24 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherA-server-1028770785</nova:name>
Nov 14 03:44:24 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:44:23</nova:creationTime>
Nov 14 03:44:24 user nova-compute[74836]:       <nova:flavor name="m1.small">
Nov 14 03:44:24 user nova-compute[74836]:         <nova:memory>2048</nova:memory>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:disk>20</nova:disk>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:44:24 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:44:24 user nova-compute[74836]:       <nova:owner>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:user uuid="f9aff38e58fe4a1b8bd4d46ceda55ba3">tempest-ServerActionsTestOtherA-585001335-project-member</nova:user>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:project uuid="06e7a009680c4c6d80ab5bb26d05b100">tempest-ServerActionsTestOtherA-585001335</nova:project>
Nov 14 03:44:24 user nova-compute[74836]:       </nova:owner>
Nov 14 03:44:24 user nova-compute[74836]:       <nova:ports>
Nov 14 03:44:24 user nova-compute[74836]:         <nova:port uuid="bbefd00c-ed80-4225-b8a2-fb748de8ff46">
Nov 14 03:44:24 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:44:24 user nova-compute[74836]:         </nova:port>
Nov 14 03:44:24 user nova-compute[74836]:       </nova:ports>
Nov 14 03:44:24 user nova-compute[74836]:     </nova:instance>
Nov 14 03:44:24 user nova-compute[74836]:   </metadata>
Nov 14 03:44:24 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:44:24 user nova-compute[74836]:     <system>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="serial">7ef95a37-bfa0-4af9-9ed8-993af09116f6</entry>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="uuid">7ef95a37-bfa0-4af9-9ed8-993af09116f6</entry>
Nov 14 03:44:24 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:44:24 user nova-compute[74836]:     </system>
Nov 14 03:44:24 user nova-compute[74836]:   </sysinfo>
Nov 14 03:44:24 user nova-compute[74836]:   <os>
Nov 14 03:44:24 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:44:24 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:44:24 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:44:24 user nova-compute[74836]:   </os>
Nov 14 03:44:24 user nova-compute[74836]:   <features>
Nov 14 03:44:24 user nova-compute[74836]:     <acpi/>
Nov 14 03:44:24 user nova-compute[74836]:     <apic/>
Nov 14 03:44:24 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:44:24 user nova-compute[74836]:   </features>
Nov 14 03:44:24 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:44:24 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:44:24 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:44:24 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:44:24 user nova-compute[74836]:   </clock>
Nov 14 03:44:24 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:44:24 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:44:24 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:44:24 user nova-compute[74836]:   </cpu>
Nov 14 03:44:24 user nova-compute[74836]:   <devices>
Nov 14 03:44:24 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:44:24 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:44:24 user nova-compute[74836]:       <source dev="/dev/sdg"/>
Nov 14 03:44:24 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:44:24 user nova-compute[74836]:       <serial>3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa</serial>
Nov 14 03:44:24 user nova-compute[74836]:     </disk>
Nov 14 03:44:24 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:44:24 user nova-compute[74836]:       <mac address="fa:16:3e:ed:09:e5"/>
Nov 14 03:44:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:24 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:44:24 user nova-compute[74836]:       <target dev="tapbbefd00c-ed"/>
Nov 14 03:44:24 user nova-compute[74836]:     </interface>
Nov 14 03:44:24 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:44:24 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6/console.log" append="off"/>
Nov 14 03:44:24 user nova-compute[74836]:     </serial>
Nov 14 03:44:24 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:44:24 user nova-compute[74836]:     <video>
Nov 14 03:44:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:24 user nova-compute[74836]:     </video>
Nov 14 03:44:24 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:44:24 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:44:24 user nova-compute[74836]:     </rng>
Nov 14 03:44:24 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:44:24 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:44:24 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:44:24 user nova-compute[74836]:     </memballoon>
Nov 14 03:44:24 user nova-compute[74836]:   </devices>
Nov 14 03:44:24 user nova-compute[74836]: </domain>
Nov 14 03:44:24 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:44:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1345875204-network", "vif_mac": "fa:16:3e:ed:09:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG os_vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd48efd86-773f-5e42-9817-1293910ef8bb', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbefd00c-ed, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbefd00c-ed, col_values=(('qos', UUID('9ddf6890-b626-4c3e-beca-fb7b2feddf14')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbefd00c-ed, col_values=(('external_ids', {'iface-id': 'bbefd00c-ed80-4225-b8a2-fb748de8ff46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:09:e5', 'vm-uuid': '7ef95a37-bfa0-4af9-9ed8-993af09116f6'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:24 user nova-compute[74836]: INFO os_vif [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed')
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:44:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] No VIF found with MAC fa:16:3e:ed:09:e5, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:44:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:26 user nova-compute[74836]: WARNING nova.compute.manager [req-0935e540-e2c2-4442-8998-ed1d37448071 req-1e31b172-0f84-4ceb-be46-cded790c5f89 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state active and task_state resize_finish.
Nov 14 03:44:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:44:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance running successfully.
Nov 14 03:44:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Failed to set time: agent not configured {{(pid=74836) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-169c89cd-2fff-4164-bb97-e8878110237e tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] finish_migration finished successfully. {{(pid=74836) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:28 user nova-compute[74836]: WARNING nova.compute.manager [req-b481b556-3a91-4496-8841-3b0329ff4199 req-1b14dc0a-2adf-48a8-b47d-3077035eb5ef service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state active and task_state resize_finish.
Nov 14 03:44:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:37 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:44:37 user nova-compute[74836]: INFO nova.compute.claims [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Claim successful on node user
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:44:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.policy [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3983545cf6a4d46858c309b90436dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6087e90cb4f047b089b12a1e35e125ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:44:38 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Creating image(s)
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "/opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk 1073741824" returned: 0 in 0.050s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Successfully created port: 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.224s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Cannot resize image /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Ensure instance console log exists: /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Successfully updated port: 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquired lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-changed-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Refreshing instance network info cache due to event network-changed-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] Acquiring lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating instance_info_cache with network_info: [{"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Releasing lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Instance network_info: |[{"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] Acquired lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.network.neutron [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Refreshing network info cache for port 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Start _get_guest_xml network_info=[{"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:44:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-699444493',display_name='tempest-AttachVolumeNegativeTest-server-699444493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-699444493',id=38,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuE7Tu7FI/qLBSiDCi72FMZDcrXfW49mEo27gChpoxMoC1MXyBzfcfqzt4oR6551XMQPHwtItc1yBfTxNDBRetmQNUCBZHH1icsp7ToGPSDQpddue6RpXTUqT+jg/BH1w==',key_name='tempest-keypair-1365536818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-xp81nblt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=af4b1c06-4c84-469b-bf10-67a832af22b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.objects.instance [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'pci_devices' on Instance uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:44:40 user nova-compute[74836]:   <uuid>af4b1c06-4c84-469b-bf10-67a832af22b5</uuid>
Nov 14 03:44:40 user nova-compute[74836]:   <name>instance-00000026</name>
Nov 14 03:44:40 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:44:40 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:44:40 user nova-compute[74836]:   <metadata>
Nov 14 03:44:40 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:44:40 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeNegativeTest-server-699444493</nova:name>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:44:40</nova:creationTime>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:44:40 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:44:40 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:owner>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:user uuid="a3983545cf6a4d46858c309b90436dcd">tempest-AttachVolumeNegativeTest-1016966726-project-member</nova:user>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:project uuid="6087e90cb4f047b089b12a1e35e125ed">tempest-AttachVolumeNegativeTest-1016966726</nova:project>
Nov 14 03:44:40 user nova-compute[74836]:       </nova:owner>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:44:40 user nova-compute[74836]:       <nova:ports>
Nov 14 03:44:40 user nova-compute[74836]:         <nova:port uuid="17dcb8cf-f869-4a23-96e8-ca9d6f581b3e">
Nov 14 03:44:40 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:44:40 user nova-compute[74836]:         </nova:port>
Nov 14 03:44:40 user nova-compute[74836]:       </nova:ports>
Nov 14 03:44:40 user nova-compute[74836]:     </nova:instance>
Nov 14 03:44:40 user nova-compute[74836]:   </metadata>
Nov 14 03:44:40 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:44:40 user nova-compute[74836]:     <system>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="serial">af4b1c06-4c84-469b-bf10-67a832af22b5</entry>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="uuid">af4b1c06-4c84-469b-bf10-67a832af22b5</entry>
Nov 14 03:44:40 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:44:40 user nova-compute[74836]:     </system>
Nov 14 03:44:40 user nova-compute[74836]:   </sysinfo>
Nov 14 03:44:40 user nova-compute[74836]:   <os>
Nov 14 03:44:40 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:44:40 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:44:40 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:44:40 user nova-compute[74836]:   </os>
Nov 14 03:44:40 user nova-compute[74836]:   <features>
Nov 14 03:44:40 user nova-compute[74836]:     <acpi/>
Nov 14 03:44:40 user nova-compute[74836]:     <apic/>
Nov 14 03:44:40 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:44:40 user nova-compute[74836]:   </features>
Nov 14 03:44:40 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:44:40 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:44:40 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:44:40 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:44:40 user nova-compute[74836]:   </clock>
Nov 14 03:44:40 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:44:40 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:44:40 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:44:40 user nova-compute[74836]:   </cpu>
Nov 14 03:44:40 user nova-compute[74836]:   <devices>
Nov 14 03:44:40 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:44:40 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:44:40 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk"/>
Nov 14 03:44:40 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:44:40 user nova-compute[74836]:     </disk>
Nov 14 03:44:40 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:44:40 user nova-compute[74836]:       <mac address="fa:16:3e:c4:05:40"/>
Nov 14 03:44:40 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:40 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:44:40 user nova-compute[74836]:       <target dev="tap17dcb8cf-f8"/>
Nov 14 03:44:40 user nova-compute[74836]:     </interface>
Nov 14 03:44:40 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:44:40 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/console.log" append="off"/>
Nov 14 03:44:40 user nova-compute[74836]:     </serial>
Nov 14 03:44:40 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:44:40 user nova-compute[74836]:     <video>
Nov 14 03:44:40 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:44:40 user nova-compute[74836]:     </video>
Nov 14 03:44:40 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:44:40 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:44:40 user nova-compute[74836]:     </rng>
Nov 14 03:44:40 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:44:40 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:44:40 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:44:40 user nova-compute[74836]:     </memballoon>
Nov 14 03:44:40 user nova-compute[74836]:   </devices>
Nov 14 03:44:40 user nova-compute[74836]: </domain>
Nov 14 03:44:40 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-699444493',display_name='tempest-AttachVolumeNegativeTest-server-699444493',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-699444493',id=38,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuE7Tu7FI/qLBSiDCi72FMZDcrXfW49mEo27gChpoxMoC1MXyBzfcfqzt4oR6551XMQPHwtItc1yBfTxNDBRetmQNUCBZHH1icsp7ToGPSDQpddue6RpXTUqT+jg/BH1w==',key_name='tempest-keypair-1365536818',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-xp81nblt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=af4b1c06-4c84-469b-bf10-67a832af22b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG os_vif [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f911eb5c-c544-5838-af89-f913abd28f0d', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17dcb8cf-f8, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17dcb8cf-f8, col_values=(('qos', UUID('1df6a97d-87d5-48c9-ba3c-d3e98a56cba2')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17dcb8cf-f8, col_values=(('external_ids', {'iface-id': '17dcb8cf-f869-4a23-96e8-ca9d6f581b3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:05:40', 'vm-uuid': 'af4b1c06-4c84-469b-bf10-67a832af22b5'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:40 user nova-compute[74836]: INFO os_vif [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8')
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:c4:05:40, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.neutron [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updated VIF entry in instance network info cache for port 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG nova.network.neutron [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating instance_info_cache with network_info: [{"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a12515fe-2746-4521-9ce3-1eef74303aaa req-0b497bab-5a78-4b1c-8aff-18e9f11aece7 service nova] Releasing lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] No waiting events found dispatching network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:41 user nova-compute[74836]: WARNING nova.compute.manager [req-a87c360d-21c2-4b0e-9b8e-0206c94d2845 req-2d68449f-928c-4f57-bc6c-31e31846886c service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received unexpected event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e for instance with vm_state building and task_state spawning.
Nov 14 03:44:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:44:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Instance spawned successfully.
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] No waiting events found dispatching network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:44:43 user nova-compute[74836]: WARNING nova.compute.manager [req-0d64e1a1-7083-4f39-8e42-03a47e199625 req-9d00fbe1-c400-4e41-9f61-28ad5f60e15d service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received unexpected event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e for instance with vm_state building and task_state spawning.
Nov 14 03:44:43 user nova-compute[74836]: INFO nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Took 5.25 seconds to spawn the instance on the hypervisor.
Nov 14 03:44:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:44:43 user nova-compute[74836]: INFO nova.compute.manager [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Took 6.15 seconds to build instance.
Nov 14 03:44:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-986bb222-9e21-40c1-8d52-30eddf248145 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.247s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:44:54 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing instance network info cache due to event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG nova.network.neutron [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: INFO nova.compute.manager [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Detaching volume 52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updated VIF entry in instance network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.network.neutron [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4ec2bb2d-5677-4413-8371-68602b239289 req-ff6cad61-b69a-4bdc-a679-a60a27db04e3 service nova] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:44:58 user nova-compute[74836]: INFO nova.virt.block_device [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Attempting to driver detach volume 52b77e35-f22f-4bae-9852-6400ef76e5bb from mountpoint /dev/vdb
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Attempting to detach device vdb from instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:44:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:44:58 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:44:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:44:58 user nova-compute[74836]:   <serial>52b77e35-f22f-4bae-9852-6400ef76e5bb</serial>
Nov 14 03:44:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:44:58 user nova-compute[74836]: </disk>
Nov 14 03:44:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:44:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully detached device vdb from instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 from the persistent domain config.
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:44:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:44:58 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:44:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:44:58 user nova-compute[74836]:   <serial>52b77e35-f22f-4bae-9852-6400ef76e5bb</serial>
Nov 14 03:44:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:44:58 user nova-compute[74836]: </disk>
Nov 14 03:44:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing instance network info cache due to event network-changed-2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] Acquiring lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] Acquired lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG nova.network.neutron [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Refreshing network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:44:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updated VIF entry in instance network info cache for port 2d882c7e-fe70-4388-b57e-cb89619a2bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [{"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b26be17a-15bc-4189-9ac9-27ab795ba72d req-8bb3d5ea-5f92-41dc-88f1-d412a2cd8179 service nova] Releasing lock "refresh_cache-01faa8a1-4b13-4d21-a1e6-01953fe394c8" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:01 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:45:01 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=6767MB free_disk=24.571002960205078GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:01 user nova-compute[74836]: INFO nova.compute.manager [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Detaching volume b27fea05-38c3-4fec-893f-57769bff4ec5
Nov 14 03:45:01 user nova-compute[74836]: INFO nova.virt.block_device [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Attempting to driver detach volume b27fea05-38c3-4fec-893f-57769bff4ec5 from mountpoint /dev/vdc
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Attempting to detach device vdc from instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:45:01 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:45:01 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:45:01 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 03:45:01 user nova-compute[74836]:   <serial>b27fea05-38c3-4fec-893f-57769bff4ec5</serial>
Nov 14 03:45:01 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:45:01 user nova-compute[74836]: </disk>
Nov 14 03:45:01 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:45:01 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully detached device vdc from instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 from the persistent domain config.
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:45:01 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:45:01 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:45:01 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 03:45:01 user nova-compute[74836]:   <serial>b27fea05-38c3-4fec-893f-57769bff4ec5</serial>
Nov 14 03:45:01 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:45:01 user nova-compute[74836]: </disk>
Nov 14 03:45:01 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Applying migration context for instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 as it has an incoming, in-progress migration 51d981bf-895f-44eb-81ee-5447a6c2aca9. Migration status is finished {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 03:45:01 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating resource usage from migration 51d981bf-895f-44eb-81ee-5447a6c2aca9
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 974f1e28-ceff-4235-99d5-0c3e34273482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0b20ec3b-612a-4124-af35-fcf0c6f1c964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Migration 51d981bf-895f-44eb-81ee-5447a6c2aca9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance af4b1c06-4c84-469b-bf10-67a832af22b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 17 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:45:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=10752MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=17 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:45:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:45:02 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:45:02 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:45:02 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:45:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:45:03 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [{"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-07ea4caa-d030-4ca6-b716-49d37a2d7a0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-changed-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing instance network info cache due to event network-changed-3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] Acquiring lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] Acquired lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updated VIF entry in instance network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating instance_info_cache with network_info: [{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-79254929-5718-4282-868e-d9f2642c5577 req-9d19a187-04b8-4a35-b1d4-b167af239670 service nova] Releasing lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG nova.objects.instance [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:17 user nova-compute[74836]: INFO nova.compute.manager [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Attaching volume 780a0aea-46ff-41db-bd5f-87da7e12a085 to /dev/vdb
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.utils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa67bd03-f96e-4bc6-91dd-6128bbb5df95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae7d34-ef83-4ccb-9be0-8e0d58ce6795]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[749b1dea-3f10-48ea-8859-213e3214c424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[05647dc8-fb62-42f7-a6f6-08bb93bbabc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:45:17 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:45:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f5d1b2-d0d9-4175-ad21-564d01a2ae39]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG os_brick.utils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:17 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating existing volume attachment record: 3780a7a9-12f6-4f0e-a097-51eb56c72a0b {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:45:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 is timed out.
Nov 14 03:45:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully detached device vdb from instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8 from the live domain config.
Nov 14 03:45:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFdEOWeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67befa8-00e9-47ee-a46a-d76a6fee07b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:45:18 user nova-compute[74836]: No targets found.
Nov 14 03:45:18 user nova-compute[74836]: iSNS:
Nov 14 03:45:18 user nova-compute[74836]: No targets found.
Nov 14 03:45:18 user nova-compute[74836]: STATIC:
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:45:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:18 user nova-compute[74836]: FIRMWARE:
Nov 14 03:45:18 user nova-compute[74836]: No targets found.
Nov 14 03:45:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:45:18 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:45:18 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c7f0c7-cedb-40da-83ce-2d9dffb89da7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3533b5-0d28-4a89-9be9-c45125a3bfd1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d46c7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da1c4dd-1754-4548-8538-0b7bf4b66177]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eefb27f-a565-4778-95d8-4fd4e9fc0d6b]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04304230-d015-48e7-a2ea-bd57b89880d4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173f615-0286-4d37-a7dd-ac51e805a98f]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d412b617-2135-4188-a9a4-6caddd049586]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a9828-ccfd-41ed-9091-e82fa28f3742]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260]
Nov 14 03:45:19 user nova-compute[74836]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb, portal: 172.16.0.220,3260] successful.
Nov 14 03:45:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b77e35-f22f-4bae-9852-6400ef76e5bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1186208b-0c62-4b24-8dda-c73d0aa89e96]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] <== disconnect_volume: return (309ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'flavor' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-00f09620-53ca-4763-be6a-5838774fde50 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtdgmAYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:21 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:45:21 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:45:21 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[14637c7f-341f-4b9c-a9a3-e91b727aa47a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:45:21 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba7b948-6bca-4f0e-ba4a-8936ca1839e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085] added
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5133a0-12bd-4107-b85b-b9dc8d0deb0f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676df07-1a8f-42ee-80a3-f271a0cf54ff]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtdgmAYz {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KtdgmAYz" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[065357a0-d3e3-4996-88c8-b402e1174287]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KtdgmAYz'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[514a3a4c-754b-4d69-b466-d25450c2a683]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a2d3d4-5f88-4a36-992f-fcce53852618]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[625ebba7-f4d7-4c18-ab7c-6d3b5f25ba49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260]
Nov 14 03:45:21 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260] successful.
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0453dca-48da-48a9-a095-de827b8e3fae]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d25d4b1-4e16-49a4-9118-f1f3fb75a377]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:21 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:21 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[535ed3b4-6086-46c5-a0a5-d5baef0cb3b0]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:45:21 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtdgmAYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:45:22 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 is timed out.
Nov 14 03:45:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully detached device vdc from instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 from the live domain config.
Nov 14 03:45:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:45:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBywbeqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:22 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:45:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:45:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:45:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23637353636326438', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637353636326438', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.767s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c5fd25-6691-47f2-9cf7-b3922a09741b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:45:23 user nova-compute[74836]: No targets found.
Nov 14 03:45:23 user nova-compute[74836]: iSNS:
Nov 14 03:45:23 user nova-compute[74836]: No targets found.
Nov 14 03:45:23 user nova-compute[74836]: STATIC:
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:45:23 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:23 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:23 user nova-compute[74836]: FIRMWARE:
Nov 14 03:45:23 user nova-compute[74836]: No targets found.
Nov 14 03:45:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:45:23 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:45:23 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:45:23 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:45:23 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:45:23 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:45:23 user nova-compute[74836]:   <serial>780a0aea-46ff-41db-bd5f-87da7e12a085</serial>
Nov 14 03:45:23 user nova-compute[74836]: </disk>
Nov 14 03:45:23 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1561d143-76cf-4ad5-bbf9-d267b2fd3519]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[64882fb5-8f91-4705-ba75-aa60792f2888]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:23 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d46c7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6343cc1-2422-472a-a79b-8cbc067d256b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3b9866-6f2a-4a36-a96e-0087b3860dd3]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad9d79-1e45-4c01-9443-7264bef8a62d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c36e9-65ba-461b-8358-680da6e3ccc1]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a57e3d-c016-47af-8c9b-a758defbbdff]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f493809c-cd9b-4d43-a39f-b17812861580]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260]
Nov 14 03:45:23 user nova-compute[74836]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5, portal: 172.16.0.220,3260] successful.
Nov 14 03:45:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b27fea05-38c3-4fec-893f-57769bff4ec5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22ba0df-828e-44ea-8e89-a1319ad10c94]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] <== disconnect_volume: return (1090ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] No VIF found with MAC fa:16:3e:bc:05:58, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:45:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-337f59bb-fec7-4439-9b10-80e655eba069 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.434s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'flavor' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-28fd1544-1ef4-493b-96a1-6d7c2efff536 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.426s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:25 user nova-compute[74836]: INFO nova.compute.manager [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Detaching volume 780a0aea-46ff-41db-bd5f-87da7e12a085
Nov 14 03:45:25 user nova-compute[74836]: INFO nova.virt.block_device [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Attempting to driver detach volume 780a0aea-46ff-41db-bd5f-87da7e12a085 from mountpoint /dev/vdb
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Attempting to detach device vdb from instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:45:25 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:45:25 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:45:25 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:45:25 user nova-compute[74836]:   <serial>780a0aea-46ff-41db-bd5f-87da7e12a085</serial>
Nov 14 03:45:25 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:45:25 user nova-compute[74836]: </disk>
Nov 14 03:45:25 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:45:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully detached device vdb from instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b from the persistent domain config.
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:45:25 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:45:25 user nova-compute[74836]:   <source dev="/dev/sdd"/>
Nov 14 03:45:25 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:45:25 user nova-compute[74836]:   <serial>780a0aea-46ff-41db-bd5f-87da7e12a085</serial>
Nov 14 03:45:25 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:45:25 user nova-compute[74836]: </disk>
Nov 14 03:45:25 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:25 user nova-compute[74836]: INFO nova.compute.manager [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Terminating instance
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-unplugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] No waiting events found dispatching network-vif-unplugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-e786e5de-c3cd-4ea4-b6db-2a31e675137a req-2f61b544-ecd6-4d90-b97a-1b0015cd241e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-unplugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:45:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Instance destroyed successfully.
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lazy-loading 'resources' on Instance uuid 0b20ec3b-612a-4124-af35-fcf0c6f1c964 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-543804690',display_name='tempest-VolumesActionsTest-instance-543804690',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-543804690',id=37,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8df27ce98f4c4b3dbd2757da6dd61527',ramdisk_id='',reservation_id='r-eievdbid',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-883449369',owner_user_name='tempest-VolumesActionsTest-883449369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:43:42Z,user_data=None,user_id='d35f9323ce9c45509413703f3bc6c718',uuid=0b20ec3b-612a-4124-af35-fcf0c6f1c964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converting VIF {"id": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "address": "fa:16:3e:8f:2c:b4", "network": {"id": "2ceb3626-ad3e-45d3-b5bd-6ddf874757af", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1790610916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8df27ce98f4c4b3dbd2757da6dd61527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd12e82d-75", "ovs_interfaceid": "bd12e82d-757d-4be9-b13e-7cb9ec3fe908", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG os_vif [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd12e82d-75, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3545d109-217d-47d6-afcc-f230f08af36d) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:26 user nova-compute[74836]: INFO os_vif [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2c:b4,bridge_name='br-int',has_traffic_filtering=True,id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908,network=Network(2ceb3626-ad3e-45d3-b5bd-6ddf874757af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd12e82d-75')
Nov 14 03:45:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Deleting instance files /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964_del
Nov 14 03:45:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Deletion of /opt/stack/data/nova/instances/0b20ec3b-612a-4124-af35-fcf0c6f1c964_del complete
Nov 14 03:45:26 user nova-compute[74836]: INFO nova.compute.manager [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 03:45:26 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:45:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:27 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Took 0.64 seconds to deallocate network for instance.
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-774d6541-e004-4941-9fbd-26bacca7027a req-a4c01011-9f10-494e-bf49-9b098209d582 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-deleted-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:27 user nova-compute[74836]: INFO nova.compute.manager [req-774d6541-e004-4941-9fbd-26bacca7027a req-a4c01011-9f10-494e-bf49-9b098209d582 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Neutron deleted interface bd12e82d-757d-4be9-b13e-7cb9ec3fe908; detaching it from the instance and deleting it from the info cache
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-774d6541-e004-4941-9fbd-26bacca7027a req-a4c01011-9f10-494e-bf49-9b098209d582 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-774d6541-e004-4941-9fbd-26bacca7027a req-a4c01011-9f10-494e-bf49-9b098209d582 service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Detach interface failed, port_id=bd12e82d-757d-4be9-b13e-7cb9ec3fe908, reason: Instance 0b20ec3b-612a-4124-af35-fcf0c6f1c964 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.705s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:27 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Deleted allocations for instance 0b20ec3b-612a-4124-af35-fcf0c6f1c964
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c3bde7d7-27b9-417d-a09e-bcb8265c9016 tempest-VolumesActionsTest-883449369 tempest-VolumesActionsTest-883449369-project-member] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.419s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] Acquiring lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] Lock "0b20ec3b-612a-4124-af35-fcf0c6f1c964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] No waiting events found dispatching network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:27 user nova-compute[74836]: WARNING nova.compute.manager [req-36fde17e-26e6-4837-aeff-b031ef462a2d req-861bdbf9-ee70-4aee-a0a4-895925cceb8e service nova] [instance: 0b20ec3b-612a-4124-af35-fcf0c6f1c964] Received unexpected event network-vif-plugged-bd12e82d-757d-4be9-b13e-7cb9ec3fe908 for instance with vm_state deleted and task_state None.
Nov 14 03:45:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:34 user nova-compute[74836]: INFO nova.compute.manager [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Unrescuing
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'flavor' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:34 user nova-compute[74836]: WARNING nova.compute.manager [req-9661dc70-7f6a-4a26-8188-e726f5359788 req-c3f7db70-ffc4-4841-91e5-57d96f4fd055 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:45:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance destroyed successfully.
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:36 user nova-compute[74836]: WARNING nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:45:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing instance network info cache due to event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:36 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updated VIF entry in instance network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing instance network info cache due to event network-changed-a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquiring lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquired lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Refreshing network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updated VIF entry in instance network info cache for port a4f70871-618b-47a0-a1a3-cba1cd7e806a. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [{"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Releasing lock "refresh_cache-8c388b9c-02bb-4831-9978-9101b4050288" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:37 user nova-compute[74836]: WARNING nova.compute.manager [req-85771af5-e15b-4680-9837-e781ff0b8766 req-0d9b31c0-3800-41af-936b-3dc5c722276f service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:45:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0538e4e0-6307-401b-a3b9-83124138634e tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:45:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:38 user nova-compute[74836]: WARNING nova.compute.manager [req-7bee001d-30d4-4ea5-8a32-20527b72c9a1 req-0dc9544e-82a1-458d-9a29-caa4e82bf0c5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state active and task_state None.
Nov 14 03:45:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b is timed out.
Nov 14 03:45:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully detached device vdb from instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b from the live domain config.
Nov 14 03:45:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KtdgmAYz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[02daddbf-952f-479b-a78f-f3b83caf89b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:45:45 user nova-compute[74836]: No targets found.
Nov 14 03:45:45 user nova-compute[74836]: iSNS:
Nov 14 03:45:45 user nova-compute[74836]: No targets found.
Nov 14 03:45:45 user nova-compute[74836]: STATIC:
Nov 14 03:45:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:45:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085
Nov 14 03:45:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:45:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:45:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:45 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:45:45 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:45:45 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:45:45 user nova-compute[74836]: FIRMWARE:
Nov 14 03:45:45 user nova-compute[74836]: No targets found.
Nov 14 03:45:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:45:45 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:45:45 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a831af87-f7f6-40b6-9c21-2ec17fe961c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7124c1dd-b762-4834-9549-cb52f15018ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:45:46 user nova-compute[74836]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 (non-flash)
Nov 14 03:45:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e407be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[65080c98-7835-4782-8c0d-bc5a5308a857]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11c9c53-80fa-41b8-92c1-3739dbabc81c]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[001b0324-8374-415f-8730-10225b0cf4aa]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3044ad21-f640-489e-b6ee-6de11afd8a18]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19207a21-078d-400d-8dd9-33ea5b64a193]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fe773a-36f9-4a1d-b355-0c6b97790477]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260]
Nov 14 03:45:46 user nova-compute[74836]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085, portal: 172.16.0.220,3260] successful.
Nov 14 03:45:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:780a0aea-46ff-41db-bd5f-87da7e12a085 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4017e7a-085b-4197-b801-d0402d82e99f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] <== disconnect_volume: return (306ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'flavor' on Instance uuid 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d29c8097-eb95-48b6-9274-b82d99c5365c tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.619s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:48 user nova-compute[74836]: INFO nova.compute.manager [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Terminating instance
Nov 14 03:45:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-6fdb0633-1136-48e3-8437-a4a924948518 req-1504caa8-ab76-4343-8607-f21bdd832edd service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-unplugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Instance destroyed successfully.
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 01faa8a1-4b13-4d21-a1e6-01953fe394c8 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-578475611',display_name='tempest-ServerRescueNegativeTestJSON-server-578475611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-578475611',id=26,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ+dP51TtQPExAfVDCt6Kg0ib7rMc/PTi/ROlHFD8cNiWvNwwiBtKlwiJavZF+eVqLy160yksGdfM7Iqsg1Mnh/cuteoGQpwBkNKRdzJPJ/k6IIXseo7iTAGQvqGt43Dw==',key_name='tempest-keypair-62033315',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:41:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-oyp39kbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:43:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c470afaa49c481cbf37c789908133d7',uuid=01faa8a1-4b13-4d21-a1e6-01953fe394c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "address": "fa:16:3e:44:e0:64", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d882c7e-fe", "ovs_interfaceid": "2d882c7e-fe70-4388-b57e-cb89619a2bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG os_vif [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d882c7e-fe, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3050b23f-3b57-4c70-b3d9-19fe8680da70) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:45:49 user nova-compute[74836]: INFO os_vif [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:e0:64,bridge_name='br-int',has_traffic_filtering=True,id=2d882c7e-fe70-4388-b57e-cb89619a2bd6,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d882c7e-fe')
Nov 14 03:45:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Deleting instance files /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8_del
Nov 14 03:45:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Deletion of /opt/stack/data/nova/instances/01faa8a1-4b13-4d21-a1e6-01953fe394c8_del complete
Nov 14 03:45:49 user nova-compute[74836]: INFO nova.compute.manager [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 03:45:49 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:45:49 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:50 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Took 0.68 seconds to deallocate network for instance.
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:50 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Deleted allocations for instance 01faa8a1-4b13-4d21-a1e6-01953fe394c8
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ceb38d95-79da-4310-b0d2-a9bff68b7214 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.185s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] Acquiring lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] Lock "01faa8a1-4b13-4d21-a1e6-01953fe394c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] No waiting events found dispatching network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:50 user nova-compute[74836]: WARNING nova.compute.manager [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received unexpected event network-vif-plugged-2d882c7e-fe70-4388-b57e-cb89619a2bd6 for instance with vm_state deleted and task_state None.
Nov 14 03:45:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-123dae69-5a01-4fea-b37c-2b579561fc1b req-14929f10-8ba4-4046-a28e-55505ab154fa service nova] [instance: 01faa8a1-4b13-4d21-a1e6-01953fe394c8] Received event network-vif-deleted-2d882c7e-fe70-4388-b57e-cb89619a2bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:51 user nova-compute[74836]: INFO nova.compute.manager [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Terminating instance
Nov 14 03:45:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d5529e5-d550-40f2-9747-ce8c8a9e7589 req-a9e88965-bf8b-441c-a5bd-4a2a7dab167a service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-unplugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:45:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Instance destroyed successfully.
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'resources' on Instance uuid 3199c66c-37e1-4ce9-af73-4c9c00fb3634 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-654954825',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-654954825',id=28,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt4lSXlVx0s1RrjRFU10g22o0ubqBwvFva9WW+DhqwgdeYy4Sb/6B6Mm39Fosth8aOToFc2q7CoT/CCDrkQQzfA+8+O9a7L3fELu7kMYdQVlCcxJ4f26hU9sQ5Xx2tQ1A==',key_name='tempest-keypair-200914316',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-e9ag7r29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:43:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=3199c66c-37e1-4ce9-af73-4c9c00fb3634,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "address": "fa:16:3e:3e:16:8c", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f596b10-ed", "ovs_interfaceid": "7f596b10-ed9f-4904-9fde-62f789fd56dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG os_vif [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f596b10-ed, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3731f3e1-9e8a-4c6a-b51d-cc98c28c902d) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:52 user nova-compute[74836]: INFO os_vif [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:16:8c,bridge_name='br-int',has_traffic_filtering=True,id=7f596b10-ed9f-4904-9fde-62f789fd56dd,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f596b10-ed')
Nov 14 03:45:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Deleting instance files /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634_del
Nov 14 03:45:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Deletion of /opt/stack/data/nova/instances/3199c66c-37e1-4ce9-af73-4c9c00fb3634_del complete
Nov 14 03:45:52 user nova-compute[74836]: INFO nova.compute.manager [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 03:45:52 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:45:52 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:53 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Took 0.70 seconds to deallocate network for instance.
Nov 14 03:45:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-799019d0-8b91-43d3-8242-ab887390289f req-a1e2b66a-ec7a-42fa-a445-63e1f8166bf1 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-deleted-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:53 user nova-compute[74836]: INFO nova.compute.manager [req-799019d0-8b91-43d3-8242-ab887390289f req-a1e2b66a-ec7a-42fa-a445-63e1f8166bf1 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Neutron deleted interface 7f596b10-ed9f-4904-9fde-62f789fd56dd; detaching it from the instance and deleting it from the info cache
Nov 14 03:45:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-799019d0-8b91-43d3-8242-ab887390289f req-a1e2b66a-ec7a-42fa-a445-63e1f8166bf1 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-799019d0-8b91-43d3-8242-ab887390289f req-a1e2b66a-ec7a-42fa-a445-63e1f8166bf1 service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Detach interface failed, port_id=7f596b10-ed9f-4904-9fde-62f789fd56dd, reason: Instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:53 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] Acquiring lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] No waiting events found dispatching network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:45:54 user nova-compute[74836]: WARNING nova.compute.manager [req-24e52379-40f2-4ea3-8437-94ea1be6a7db req-a31e0d8d-c553-4402-849f-45d66e6215fe service nova] [instance: 3199c66c-37e1-4ce9-af73-4c9c00fb3634] Received unexpected event network-vif-plugged-7f596b10-ed9f-4904-9fde-62f789fd56dd for instance with vm_state deleted and task_state None.
Nov 14 03:45:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.736s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:54 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Deleted allocations for instance 3199c66c-37e1-4ce9-af73-4c9c00fb3634
Nov 14 03:45:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7783a281-f87d-4534-9910-72b5cd79a312 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "3199c66c-37e1-4ce9-af73-4c9c00fb3634" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.522s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:55 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:56 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:45:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'flavor' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:58 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:45:59 user nova-compute[74836]: INFO nova.compute.manager [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Attaching volume 5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 to /dev/vdb
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d8b72b-c00c-4d7a-abca-2d493a30108f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c257dda-e1c8-44dc-9d09-5e83f49b7ff0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b618786-ce45-4a09-b729-c18e2be6d74c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f24499-6ec7-4117-aea1-c48cb9dc367a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:45:59 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f82f4f-3c6c-4c6c-8446-ff8dd847c5a7]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG os_brick.utils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating existing volume attachment record: 9884ae32-50e0-40d4-8653-ff19c101bddb {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: INFO nova.compute.manager [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Unrescuing
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquired lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating instance_info_cache with network_info: [{"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Releasing lock "refresh_cache-974f1e28-ceff-4235-99d5-0c3e34273482" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG nova.objects.instance [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'flavor' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:45:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:00 user nova-compute[74836]: WARNING nova.compute.manager [req-61a707cf-d5b7-4738-85bf-4491e8fd3255 req-e7b86888-42bb-445e-a714-25a38c35d018 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance destroyed successfully.
Nov 14 03:46:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:02 user nova-compute[74836]: WARNING nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:02 user nova-compute[74836]: WARNING nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:02 user nova-compute[74836]: WARNING nova.compute.manager [req-f11cd9af-cd9e-4f1d-9737-d2f19690accc req-0e5effd3-edec-4c1b-b708-aad460dae2ef service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state rescued and task_state unrescuing.
Nov 14 03:46:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-65457eff-fdb4-4ea3-af84-a405878bd2be tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:04 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Going to confirm migration 1 {{(pid=74836) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 03:46:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7204MB free_disk=24.625301361083984GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d583d3ea-222c-4bdf-8c73-f7f00f5bc934]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:46:04 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af47623-05d3-406b-8e29-f1d0108f324f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[40896c45-0b90-4f75-a6f1-6dc7a3dac912]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c62e95-5954-494e-a50b-7f5f0e6e276a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3518b47-be1b-4007-90d1-d2d949818914]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHcVMSoO'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Applying migration context for instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 as it has an incoming, in-progress migration 51d981bf-895f-44eb-81ee-5447a6c2aca9. Migration status is confirming {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 03:46:04 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating resource usage from migration 51d981bf-895f-44eb-81ee-5447a6c2aca9
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9334f1fa-f277-4f82-8411-7c05a036b2ed]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8c388b9c-02bb-4831-9978-9101b4050288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 974f1e28-ceff-4235-99d5-0c3e34273482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Migration 51d981bf-895f-44eb-81ee-5447a6c2aca9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance af4b1c06-4c84-469b-bf10-67a832af22b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquired lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'info_cache' on Instance uuid 7ef95a37-bfa0-4af9-9ed8-993af09116f6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e53b1-dbd0-4305-abd7-c78b078f7f4f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e651b1-7511-4e9b-acaf-3886c81a3a6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:46:04 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c71cb4a-a973-4cd6-bab6-6e986407948e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce295df7-c65a-448d-8efa-a0ae9c89831f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:04 user nova-compute[74836]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b311cd5-9ea1-4b6a-ba09-cdb2a6b6b2be]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:46:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [{"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Releasing lock "refresh_cache-7ef95a37-bfa0-4af9-9ed8-993af09116f6" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'migration_context' on Instance uuid 7ef95a37-bfa0-4af9-9ed8-993af09116f6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.objects.base [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Object Instance<7ef95a37-bfa0-4af9-9ed8-993af09116f6> lazy-loaded attributes: info_cache,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'flavor' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:46:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:05 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:46:05 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:05 user nova-compute[74836]:   <serial>5b6b8b23-4c1c-4b88-b9ac-d708d9e48227</serial>
Nov 14 03:46:05 user nova-compute[74836]: </disk>
Nov 14 03:46:05 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:46:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.436s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:06 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Deleted allocation for migration 51d981bf-895f-44eb-81ee-5447a6c2aca9
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a8bc13d5-1668-44ed-a694-01c25d404e7f tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.704s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No VIF found with MAC fa:16:3e:dd:69:0b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0355c158-1748-4142-bb62-b080f4269aac tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.353s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [{"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:07 user nova-compute[74836]: INFO nova.compute.manager [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Detaching volume c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:46:07 user nova-compute[74836]: INFO nova.virt.block_device [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Attempting to driver detach volume c8f47496-3c48-4c35-853b-13b71a27b66a from mountpoint /dev/vdb
Nov 14 03:46:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Attempting to detach device vdb from instance 8c388b9c-02bb-4831-9978-9101b4050288 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:46:07 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:07 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:46:07 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:07 user nova-compute[74836]:   <serial>c8f47496-3c48-4c35-853b-13b71a27b66a</serial>
Nov 14 03:46:07 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:46:07 user nova-compute[74836]: </disk>
Nov 14 03:46:07 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:46:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Successfully detached device vdb from instance 8c388b9c-02bb-4831-9978-9101b4050288 from the persistent domain config.
Nov 14 03:46:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c388b9c-02bb-4831-9978-9101b4050288 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:46:07 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:07 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:46:07 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:07 user nova-compute[74836]:   <serial>c8f47496-3c48-4c35-853b-13b71a27b66a</serial>
Nov 14 03:46:07 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:46:07 user nova-compute[74836]: </disk>
Nov 14 03:46:07 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Stashing vm_state: active {{(pid=74836) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:46:08 user nova-compute[74836]: INFO nova.compute.claims [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Claim successful on node user
Nov 14 03:46:08 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating resource usage from migration 17572f18-72d1-443f-8c2e-3f47f8cf64f1
Nov 14 03:46:08 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.503s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:08 user nova-compute[74836]: INFO nova.compute.manager [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Migrating
Nov 14 03:46:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Starting migrate_disk_and_power_off {{(pid=74836) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:09 user nova-compute[74836]: WARNING nova.compute.manager [req-804c4f11-0475-4218-b0e6-01c3b6e946b2 req-2a32b1d8-ba4e-4cd5-a5e3-cd9922819643 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state active and task_state resize_migrating.
Nov 14 03:46:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance destroyed successfully.
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb549e8cc-90, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4c651e8-7b66-45d3-9a56-b61db951690b) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:09 user nova-compute[74836]: INFO os_vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:46:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:09 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[352a493a-856f-416e-9339-bfdcf812c7a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:46:09 user nova-compute[74836]: No targets found.
Nov 14 03:46:09 user nova-compute[74836]: iSNS:
Nov 14 03:46:09 user nova-compute[74836]: No targets found.
Nov 14 03:46:09 user nova-compute[74836]: STATIC:
Nov 14 03:46:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:46:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:46:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:46:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:46:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:46:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:09 user nova-compute[74836]: FIRMWARE:
Nov 14 03:46:09 user nova-compute[74836]: No targets found.
Nov 14 03:46:09 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:46:09 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:46:09 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:46:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[302ae3e9-ae1d-463c-ad9b-0f0b25dbc0f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4320bf93-d8b2-47a3-9d1f-62c83e46236f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:10 user nova-compute[74836]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4472dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[159d2cde-d3cb-433e-aa1d-fda80145c2f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b62dff-18c7-44aa-91cc-3194f3cb2661]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2d4c4-4c97-46ec-85d2-c36e331a20d9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[88628757-7915-4a4c-9618-1bc4001ba580]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a312670b-94cf-4dbb-865b-2277da66b6dd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b2a866-8d11-4f75-9f57-e937e0883ac0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:46:10 user nova-compute[74836]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:46:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31293b2-f254-433a-9cae-f738c6b5deaa]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== disconnect_volume: return (315ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_resize/disk /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "cp -r /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_resize/disk /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk" returned: 0 in 0.253s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_resize/disk.info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk.info {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "cp -r /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_resize/disk.info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk.info" returned: 0 in 0.038s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:11 user nova-compute[74836]: WARNING nova.compute.manager [req-cc277c76-a137-4f66-937c-346532bb5ee2 req-3137bc2c-1243-470a-ab3b-28f36808d380 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state active and task_state resize_migrating.
Nov 14 03:46:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Port b549e8cc-909f-4450-9b90-afd13379e321 binding to destination host user is already ACTIVE {{(pid=74836) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.utils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[df218822-3b2a-42ee-b26f-faf617efd92e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a582e2-41c6-44e4-9c9d-a318cabc71ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f680e1-f307-41be-8405-94dfa46062de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f589f8-edd0-4758-a8ef-ad700e815e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:46:13 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:46:13 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad217ee4-dc49-4fe5-921c-2d5d10b0f6cb]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:46:13 user nova-compute[74836]: DEBUG os_brick.utils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-changed-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing instance network info cache due to event network-changed-3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] Acquiring lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] Acquired lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Refreshing network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:16 user nova-compute[74836]: INFO nova.compute.manager [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Terminating instance
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-unplugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] No waiting events found dispatching network-vif-unplugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-1e9b9173-daea-4e91-ab32-cacdbdb2f4d5 req-53dfd3d6-e754-481a-8c0d-82dff91fb62d service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-unplugged-3f10538b-1826-413f-a37d-4f0238167af5 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updated VIF entry in instance network info cache for port 3f10538b-1826-413f-a37d-4f0238167af5. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating instance_info_cache with network_info: [{"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9e03804f-6203-44d3-b8a7-7a6a69602311 req-9219cf5b-7043-4a20-a5cf-8e010e416a35 service nova] Releasing lock "refresh_cache-8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Instance destroyed successfully.
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.objects.instance [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'resources' on Instance uuid 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:43:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-685729348',display_name='tempest-TestStampPattern-server-685729348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-685729348',id=36,image_ref='f25abdc4-28fe-49ff-bd3b-cd50e7bbd55b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:43:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-gwwxvmtr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99',image_min_disk='1',image_min_ram='0',image_owner_id='66e650c0a29644dcbbb797a589e94729',image_owner_project_name='tempest-TestStampPattern-6640805',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-6640805-project-member',image_user_id='ed5afea1b58e4115957a8435f15ec95f',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:43:31Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=8e7f7ece-9b05-4a83-925d-cc7fbbb5802b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "3f10538b-1826-413f-a37d-4f0238167af5", "address": "fa:16:3e:bc:05:58", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f10538b-18", "ovs_interfaceid": "3f10538b-1826-413f-a37d-4f0238167af5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG os_vif [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f10538b-18, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0192e0f-3521-4e39-8aa1-935ebe7b0300) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:17 user nova-compute[74836]: INFO os_vif [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:05:58,bridge_name='br-int',has_traffic_filtering=True,id=3f10538b-1826-413f-a37d-4f0238167af5,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f10538b-18')
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Deleting instance files /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b_del
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Deletion of /opt/stack/data/nova/instances/8e7f7ece-9b05-4a83-925d-cc7fbbb5802b_del complete
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.compute.manager [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Starting finish_migration {{(pid=74836) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance directory exists: not creating {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Creating image(s)
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:17 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Took 0.58 seconds to deallocate network for instance.
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-0bde307d-ffd5-424b-96b6-5e1c6a51036a req-99e89dcd-0486-4373-8a79-e35144ca7c55 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-deleted-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.217s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk. size=21474836480 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk 21474836480 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk 21474836480" returned: 0 in 0.222s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Ensure instance console log exists: /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start _get_guest_xml network_info=[{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '80245c74-184f-47a3-8b7f-37bea4240a7a', 'attached_at': '2023-11-14T03:46:17.000000', 'detached_at': '', 'volume_id': '5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'serial': '5b6b8b23-4c1c-4b88-b9ac-d708d9e48227'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '7ad530ef-e976-4649-a915-998a154d7bd3', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:46:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:18 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdb8d1b-fafe-45e7-a52f-3e5d1dd45848]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:46:18 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a6ad01-1ed5-4ddd-8aca-5ace5fc89b07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e37c4ed-ca96-44b7-962f-9bc0e710db8e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c435ff-339c-4b92-b417-c88f2d1e8dd9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[471f46b6-13cd-4efc-87f8-ec9e56338e16]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHcVMSoO'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Deleted allocations for instance 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ea64f9-57dc-44f6-93ab-395a2a8e3d63]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5685651e-5e72-483a-b835-6b95927f05cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] Acquiring lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] No waiting events found dispatching network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:18 user nova-compute[74836]: WARNING nova.compute.manager [req-8d93a5ba-8173-40d2-9adb-e927e4769799 req-f03b147b-fb45-4695-a081-641c1d747f89 service nova] [instance: 8e7f7ece-9b05-4a83-925d-cc7fbbb5802b] Received unexpected event network-vif-plugged-3f10538b-1826-413f-a37d-4f0238167af5 for instance with vm_state deleted and task_state None.
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[653a62a3-fec5-4e27-822f-1715b4c40093]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-476d9fed-08cb-4f36-9cb9-839fa77aea71 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "8e7f7ece-9b05-4a83-925d-cc7fbbb5802b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.481s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:46:18 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6214ed6-a1b1-4cda-8924-6b066e0628d7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b22db-9ba9-4cc3-976a-f5cbf2384047]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:18 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e275d1f-d6cf-43e3-9b7c-5d339e760201]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:46:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:46:19 user nova-compute[74836]:   <uuid>80245c74-184f-47a3-8b7f-37bea4240a7a</uuid>
Nov 14 03:46:19 user nova-compute[74836]:   <name>instance-00000021</name>
Nov 14 03:46:19 user nova-compute[74836]:   <memory>2097152</memory>
Nov 14 03:46:19 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:46:19 user nova-compute[74836]:   <metadata>
Nov 14 03:46:19 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:46:19 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077651375</nova:name>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:46:18</nova:creationTime>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:flavor name="m1.small">
Nov 14 03:46:19 user nova-compute[74836]:         <nova:memory>2048</nova:memory>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:disk>20</nova:disk>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:46:19 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:owner>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:user uuid="6b1b556cd49347c0bca921f02527a3bf">tempest-ServerActionsTestOtherB-1529116963-project-member</nova:user>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:project uuid="e55bd47c746b472496433ecbbc6115c3">tempest-ServerActionsTestOtherB-1529116963</nova:project>
Nov 14 03:46:19 user nova-compute[74836]:       </nova:owner>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:46:19 user nova-compute[74836]:       <nova:ports>
Nov 14 03:46:19 user nova-compute[74836]:         <nova:port uuid="b549e8cc-909f-4450-9b90-afd13379e321">
Nov 14 03:46:19 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:46:19 user nova-compute[74836]:         </nova:port>
Nov 14 03:46:19 user nova-compute[74836]:       </nova:ports>
Nov 14 03:46:19 user nova-compute[74836]:     </nova:instance>
Nov 14 03:46:19 user nova-compute[74836]:   </metadata>
Nov 14 03:46:19 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:46:19 user nova-compute[74836]:     <system>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="serial">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="uuid">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:46:19 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:46:19 user nova-compute[74836]:     </system>
Nov 14 03:46:19 user nova-compute[74836]:   </sysinfo>
Nov 14 03:46:19 user nova-compute[74836]:   <os>
Nov 14 03:46:19 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:46:19 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:46:19 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:46:19 user nova-compute[74836]:   </os>
Nov 14 03:46:19 user nova-compute[74836]:   <features>
Nov 14 03:46:19 user nova-compute[74836]:     <acpi/>
Nov 14 03:46:19 user nova-compute[74836]:     <apic/>
Nov 14 03:46:19 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:46:19 user nova-compute[74836]:   </features>
Nov 14 03:46:19 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:46:19 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:46:19 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:46:19 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:46:19 user nova-compute[74836]:   </clock>
Nov 14 03:46:19 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:46:19 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:46:19 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:46:19 user nova-compute[74836]:   </cpu>
Nov 14 03:46:19 user nova-compute[74836]:   <devices>
Nov 14 03:46:19 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:46:19 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:46:19 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk"/>
Nov 14 03:46:19 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:46:19 user nova-compute[74836]:     </disk>
Nov 14 03:46:19 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:46:19 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:19 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:46:19 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:46:19 user nova-compute[74836]:       <serial>5b6b8b23-4c1c-4b88-b9ac-d708d9e48227</serial>
Nov 14 03:46:19 user nova-compute[74836]:     </disk>
Nov 14 03:46:19 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:46:19 user nova-compute[74836]:       <mac address="fa:16:3e:dd:69:0b"/>
Nov 14 03:46:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:46:19 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:46:19 user nova-compute[74836]:       <target dev="tapb549e8cc-90"/>
Nov 14 03:46:19 user nova-compute[74836]:     </interface>
Nov 14 03:46:19 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:46:19 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/console.log" append="off"/>
Nov 14 03:46:19 user nova-compute[74836]:     </serial>
Nov 14 03:46:19 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:46:19 user nova-compute[74836]:     <video>
Nov 14 03:46:19 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:46:19 user nova-compute[74836]:     </video>
Nov 14 03:46:19 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:46:19 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:46:19 user nova-compute[74836]:     </rng>
Nov 14 03:46:19 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:46:19 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:46:19 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:46:19 user nova-compute[74836]:     </memballoon>
Nov 14 03:46:19 user nova-compute[74836]:   </devices>
Nov 14 03:46:19 user nova-compute[74836]: </domain>
Nov 14 03:46:19 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:42:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1341186127-network", "vif_mac": "fa:16:3e:dd:69:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG os_vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae9ba8a6-8699-5051-a104-1a2bf7e8eae8', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb549e8cc-90, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb549e8cc-90, col_values=(('qos', UUID('ac0101a5-8c16-4e31-8d1d-b08f272e0a43')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb549e8cc-90, col_values=(('external_ids', {'iface-id': 'b549e8cc-909f-4450-9b90-afd13379e321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:69:0b', 'vm-uuid': '80245c74-184f-47a3-8b7f-37bea4240a7a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:19 user nova-compute[74836]: INFO os_vif [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] No VIF found with MAC fa:16:3e:dd:69:0b, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:21 user nova-compute[74836]: WARNING nova.compute.manager [req-f89b7b6f-5ea1-43ed-ac8b-4ebba3c948a7 req-964abce1-ec6c-4f54-b953-6592b8613905 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state active and task_state resize_finish.
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:46:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance running successfully.
Nov 14 03:46:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Failed to set time: agent not configured {{(pid=74836) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a2695acf-dd6c-4fbb-850d-df8f34042cd4 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] finish_migration finished successfully. {{(pid=74836) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:23 user nova-compute[74836]: WARNING nova.compute.manager [req-ddb71c3f-54c1-471c-bf73-6a15e189cd99 req-39967f14-fe7d-4e26-a9c1-78e8e43ab63d service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state active and task_state resize_finish.
Nov 14 03:46:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:28 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c388b9c-02bb-4831-9978-9101b4050288 is timed out.
Nov 14 03:46:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Successfully detached device vdb from instance 8c388b9c-02bb-4831-9978-9101b4050288 from the live domain config.
Nov 14 03:46:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ivSlUHEk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:28 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26b42c4-73a3-4a9b-96d6-3b16dd87dbc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:46:28 user nova-compute[74836]: No targets found.
Nov 14 03:46:28 user nova-compute[74836]: iSNS:
Nov 14 03:46:28 user nova-compute[74836]: No targets found.
Nov 14 03:46:28 user nova-compute[74836]: STATIC:
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a
Nov 14 03:46:28 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:46:28 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:46:28 user nova-compute[74836]: FIRMWARE:
Nov 14 03:46:28 user nova-compute[74836]: No targets found.
Nov 14 03:46:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:46:28 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:46:28 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb349a32-b429-485c-a2d5-fbc1465cce19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1eb26-e132-46dd-b77a-1bcc33a298e8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:28 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d46c7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[15337812-da34-4c44-88fb-54bdac102ff6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1475914d-d843-4226-b8ac-c20e0a0357cc]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4d87c2-9103-455f-966c-de3ed2cae60a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9293e94-890f-4c36-a511-3b5a2d7a70c3]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[799fe70e-a730-4a85-a2d2-ad73633a8ef6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[90270150-f7c3-4a4b-b327-f12eba18034a]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260]
Nov 14 03:46:28 user nova-compute[74836]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a, portal: 172.16.0.220,3260] successful.
Nov 14 03:46:28 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8f47496-3c48-4c35-853b-13b71a27b66a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0035e970-4c7f-43ee-bfb3-da16aec58ed2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] <== disconnect_volume: return (386ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-changed-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Refreshing instance network info cache due to event network-changed-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] Acquiring lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] Acquired lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:28 user nova-compute[74836]: DEBUG nova.network.neutron [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Refreshing network info cache for port 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:46:29 user nova-compute[74836]: DEBUG nova.network.neutron [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updated VIF entry in instance network info cache for port 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:46:29 user nova-compute[74836]: DEBUG nova.network.neutron [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating instance_info_cache with network_info: [{"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-69d632ba-4a1f-43f0-90c7-963b9fe2461a req-ef4c976e-6582-4203-8ec5-2a50507989dd service nova] Releasing lock "refresh_cache-af4b1c06-4c84-469b-bf10-67a832af22b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'flavor' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-902ca5c8-0077-46c1-9d95-444932a583eb tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.489s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.276s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:32 user nova-compute[74836]: INFO nova.compute.manager [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Attaching volume 55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 to /dev/vdb
Nov 14 03:46:32 user nova-compute[74836]: DEBUG os_brick.utils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e4c3bb-62e4-4c54-ba26-f78015177154]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5782482-3ed0-4165-9105-7a8bf1e86a5d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d87003-604f-4881-b32b-9bb024ae12ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aed73c1-6182-45e2-a23e-9cc955218376]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:46:33 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:46:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a4e703-d379-4bef-af79-53c5877ea9b8]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG os_brick.utils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:33 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating existing volume attachment record: d6ad0bbd-698d-4531-b776-c6e19b6e97a6 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:46:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdDVgbls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:46:37 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:37 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:46:37 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770bebc-e4df-4754-a029-aa95c831d0de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:46:37 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085817e-e805-490b-908f-8d224c07a6ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298] added
Nov 14 03:46:37 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c514d9-f259-49b4-9d56-2627e5e01871]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb9d40c-5c00-4dfd-b00d-a906b51fcfa0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdDVgbls {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdDVgbls" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5e3340-d4cc-42a4-8b05-6ec076b14655]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdDVgbls'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc63244a-846b-4d76-931a-79198b9376ae]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc9db6a-2e3f-4d66-a989-9dbdf89aca80]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[edecf1f3-4fdd-427b-bbf8-c22d5fd58258]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260]
Nov 14 03:46:38 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260] successful.
Nov 14 03:46:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f2edd-b917-4c91-834b-ee12a4eee8d5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a20a269-d9fe-482c-b3c2-df854ee7153a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a748601d-3751-4c22-bf4e-6f28b6df649f (non-flash)
Nov 14 03:46:38 user nova-compute[74836]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)
Nov 14 03:46:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee270a9-1e33-4b53-af4a-242aa19e3fa6]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:46:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdDVgbls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26462343563376564', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462343563376564', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:46:39 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:39 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:46:39 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:39 user nova-compute[74836]:   <serial>55e40cdc-a7b8-4914-a39f-f1eaf2cd4298</serial>
Nov 14 03:46:39 user nova-compute[74836]: </disk>
Nov 14 03:46:39 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:46:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:c4:05:40, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:46:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6647d191-0741-4535-a694-09ed0a506d28 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.448s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:42 user nova-compute[74836]: INFO nova.compute.manager [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Detaching volume 55e40cdc-a7b8-4914-a39f-f1eaf2cd4298
Nov 14 03:46:42 user nova-compute[74836]: INFO nova.virt.block_device [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Attempting to driver detach volume 55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 from mountpoint /dev/vdb
Nov 14 03:46:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Attempting to detach device vdb from instance af4b1c06-4c84-469b-bf10-67a832af22b5 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:46:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:46:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:42 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:46:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:42 user nova-compute[74836]:   <serial>55e40cdc-a7b8-4914-a39f-f1eaf2cd4298</serial>
Nov 14 03:46:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:46:42 user nova-compute[74836]: </disk>
Nov 14 03:46:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:46:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance af4b1c06-4c84-469b-bf10-67a832af22b5 from the persistent domain config.
Nov 14 03:46:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance af4b1c06-4c84-469b-bf10-67a832af22b5 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:46:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:46:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:46:42 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:46:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:46:42 user nova-compute[74836]:   <serial>55e40cdc-a7b8-4914-a39f-f1eaf2cd4298</serial>
Nov 14 03:46:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:46:42 user nova-compute[74836]: </disk>
Nov 14 03:46:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:46:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:46:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.compute.claims [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Claim successful on node user
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.compute.manager [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Terminating instance
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-de8be5f6-6f41-4684-b07e-9ddf672e9b62 req-3cf03e9e-152d-42b9-9e9d-b2f02cc46716 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-unplugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.policy [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77ede53dd4ff404fbf5575c29105308b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42a8a057308442f981535f38628faa53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Creating image(s)
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Instance destroyed successfully.
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 2a266da1-3823-4ae8-b45c-17c1b7543a5a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-424831790',display_name='tempest-ServerRescueNegativeTestJSON-server-424831790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-424831790',id=3,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:32:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-2030xd1v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:42Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=2a266da1-3823-4ae8-b45c-17c1b7543a5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "address": "fa:16:3e:48:37:d9", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6561cb21-a7", "ovs_interfaceid": "6561cb21-a719-4b80-b0fc-1c6d2e2de49a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG os_vif [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6561cb21-a7, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e905484d-f4f4-48af-9c2e-c6c0040894ad) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:46 user nova-compute[74836]: INFO os_vif [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:37:d9,bridge_name='br-int',has_traffic_filtering=True,id=6561cb21-a719-4b80-b0fc-1c6d2e2de49a,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6561cb21-a7')
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Deleting instance files /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a_del
Nov 14 03:46:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Deletion of /opt/stack/data/nova/instances/2a266da1-3823-4ae8-b45c-17c1b7543a5a_del complete
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:47 user nova-compute[74836]: INFO nova.compute.manager [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk 1073741824" returned: 0 in 0.049s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:47 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Took 0.44 seconds to deallocate network for instance.
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Successfully created port: 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Cannot resize image /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Ensure instance console log exists: /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:46:47 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:48 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Deleted allocations for instance 2a266da1-3823-4ae8-b45c-17c1b7543a5a
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-467b9bc9-d2c0-4865-9de3-855ba8f895d4 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Successfully updated port: 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing instance network info cache due to event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] Acquiring lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] Lock "2a266da1-3823-4ae8-b45c-17c1b7543a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] No waiting events found dispatching network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:48 user nova-compute[74836]: WARNING nova.compute.manager [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received unexpected event network-vif-plugged-6561cb21-a719-4b80-b0fc-1c6d2e2de49a for instance with vm_state deleted and task_state None.
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-02671e96-2d30-4ab0-b524-8db590baff1f req-446db7b1-89f0-4316-af36-cad41ebcea28 service nova] [instance: 2a266da1-3823-4ae8-b45c-17c1b7543a5a] Received event network-vif-deleted-6561cb21-a719-4b80-b0fc-1c6d2e2de49a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance network_info: |[{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start _get_guest_xml network_info=[{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:46:48 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:48 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORHWbQGrZhoOBMY+RQqVARDHoLUtY5oX2mi+ndlT1uBJJVa9hR++fbH3dCDNps/REcq5GElrm8bO8FEOlBI3PraJA2TYTEos1cHpMTFMr1NBIdyti6zR8LtH0GOirqkYQ==',key_name='tempest-keypair-1425264219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.objects.instance [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_devices' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:46:48 user nova-compute[74836]:   <uuid>db4cbd53-aabe-4b4c-9fc2-65a593d301d4</uuid>
Nov 14 03:46:48 user nova-compute[74836]:   <name>instance-00000027</name>
Nov 14 03:46:48 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:46:48 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:46:48 user nova-compute[74836]:   <metadata>
Nov 14 03:46:48 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:46:48 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1592147205</nova:name>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:46:48</nova:creationTime>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:46:48 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:46:48 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:owner>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:user uuid="77ede53dd4ff404fbf5575c29105308b">tempest-AttachVolumeShelveTestJSON-267361624-project-member</nova:user>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:project uuid="42a8a057308442f981535f38628faa53">tempest-AttachVolumeShelveTestJSON-267361624</nova:project>
Nov 14 03:46:48 user nova-compute[74836]:       </nova:owner>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:46:48 user nova-compute[74836]:       <nova:ports>
Nov 14 03:46:48 user nova-compute[74836]:         <nova:port uuid="2c479662-53e5-41d4-bc51-5b25e4cd272d">
Nov 14 03:46:48 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:46:48 user nova-compute[74836]:         </nova:port>
Nov 14 03:46:48 user nova-compute[74836]:       </nova:ports>
Nov 14 03:46:48 user nova-compute[74836]:     </nova:instance>
Nov 14 03:46:48 user nova-compute[74836]:   </metadata>
Nov 14 03:46:48 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:46:48 user nova-compute[74836]:     <system>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="serial">db4cbd53-aabe-4b4c-9fc2-65a593d301d4</entry>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="uuid">db4cbd53-aabe-4b4c-9fc2-65a593d301d4</entry>
Nov 14 03:46:48 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:46:48 user nova-compute[74836]:     </system>
Nov 14 03:46:48 user nova-compute[74836]:   </sysinfo>
Nov 14 03:46:48 user nova-compute[74836]:   <os>
Nov 14 03:46:48 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:46:48 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:46:48 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:46:48 user nova-compute[74836]:   </os>
Nov 14 03:46:48 user nova-compute[74836]:   <features>
Nov 14 03:46:48 user nova-compute[74836]:     <acpi/>
Nov 14 03:46:48 user nova-compute[74836]:     <apic/>
Nov 14 03:46:48 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:46:48 user nova-compute[74836]:   </features>
Nov 14 03:46:48 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:46:48 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:46:48 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:46:48 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:46:48 user nova-compute[74836]:   </clock>
Nov 14 03:46:48 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:46:48 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:46:48 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:46:48 user nova-compute[74836]:   </cpu>
Nov 14 03:46:48 user nova-compute[74836]:   <devices>
Nov 14 03:46:48 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:46:48 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:46:48 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk"/>
Nov 14 03:46:48 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:46:48 user nova-compute[74836]:     </disk>
Nov 14 03:46:48 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:46:48 user nova-compute[74836]:       <mac address="fa:16:3e:1c:9d:0d"/>
Nov 14 03:46:48 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:46:48 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:46:48 user nova-compute[74836]:       <target dev="tap2c479662-53"/>
Nov 14 03:46:48 user nova-compute[74836]:     </interface>
Nov 14 03:46:48 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:46:48 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/console.log" append="off"/>
Nov 14 03:46:48 user nova-compute[74836]:     </serial>
Nov 14 03:46:48 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:46:48 user nova-compute[74836]:     <video>
Nov 14 03:46:48 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:46:48 user nova-compute[74836]:     </video>
Nov 14 03:46:48 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:46:48 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:46:48 user nova-compute[74836]:     </rng>
Nov 14 03:46:48 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:46:48 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:46:48 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:46:48 user nova-compute[74836]:     </memballoon>
Nov 14 03:46:48 user nova-compute[74836]:   </devices>
Nov 14 03:46:48 user nova-compute[74836]: </domain>
Nov 14 03:46:48 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORHWbQGrZhoOBMY+RQqVARDHoLUtY5oX2mi+ndlT1uBJJVa9hR++fbH3dCDNps/REcq5GElrm8bO8FEOlBI3PraJA2TYTEos1cHpMTFMr1NBIdyti6zR8LtH0GOirqkYQ==',key_name='tempest-keypair-1425264219',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG os_vif [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81b91d1b-b48d-513b-ad0f-a93e95fdcbd8', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c479662-53, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c479662-53, col_values=(('qos', UUID('7bb9170e-743c-4f20-8e3a-23cb4186fda6')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c479662-53, col_values=(('external_ids', {'iface-id': '2c479662-53e5-41d4-bc51-5b25e4cd272d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:9d:0d', 'vm-uuid': 'db4cbd53-aabe-4b4c-9fc2-65a593d301d4'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:48 user nova-compute[74836]: INFO os_vif [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53')
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No VIF found with MAC fa:16:3e:1c:9d:0d, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updated VIF entry in instance network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG nova.network.neutron [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd2827ca-ac95-4ee0-beec-cb164c64b0eb req-d84a8936-8a5a-425c-8d97-4eed29d8cbd8 service nova] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:50 user nova-compute[74836]: WARNING nova.compute.manager [req-7fb40e8b-20bb-4290-993d-6744a9a9504d req-09f2d453-344d-4222-9924-2930cc7e9486 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state building and task_state spawning.
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:46:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance spawned successfully.
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:46:52 user nova-compute[74836]: INFO nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:52 user nova-compute[74836]: WARNING nova.compute.manager [req-e44c509d-057e-418e-9714-5443ef70d5a8 req-d765ece2-ed94-41f3-a12b-a2c9fddb77c6 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state building and task_state spawning.
Nov 14 03:46:52 user nova-compute[74836]: INFO nova.compute.manager [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Took 6.64 seconds to build instance.
Nov 14 03:46:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-74d4955a-0735-4156-8d64-235963d5e02e tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.750s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:55 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:55 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:58 user nova-compute[74836]: INFO nova.compute.manager [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Terminating instance
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-c46bb520-e272-4d4c-bb4b-670cfafd77d2 req-d57dc681-36ee-4f39-8fa2-2822f18cf1e0 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-unplugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Instance destroyed successfully.
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lazy-loading 'resources' on Instance uuid 8c388b9c-02bb-4831-9978-9101b4050288 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-95912381',display_name='tempest-ServerStableDeviceRescueTest-server-95912381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-95912381',id=29,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUulbrK4M6ry0RgtySgnTgsd/I8t2nBB2ZXRuZgTHZyaTBj1FI9b2srpNwrPgxGnLmCgmWANqcDoONraM6yJ3nyCggdfbNUYCw9DFdm3b9ZCMD/uvUqUp+mEAd4lk4xZw==',key_name='tempest-keypair-982684915',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:43:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd43e6daeb32480a83a53334ddf46567',ramdisk_id='',reservation_id='r-lfr817sd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-996871557',owner_user_name='tempest-ServerStableDeviceRescueTest-996871557-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16e5d6e474e54299a2cbe8094a46d896',uuid=8c388b9c-02bb-4831-9978-9101b4050288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converting VIF {"id": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "address": "fa:16:3e:07:fb:b9", "network": {"id": "e170a239-3f7a-49d7-8c73-8b66379dfc9a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2086247462-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd43e6daeb32480a83a53334ddf46567", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4f70871-61", "ovs_interfaceid": "a4f70871-618b-47a0-a1a3-cba1cd7e806a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG os_vif [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4f70871-61, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=189cacb9-5284-4195-b320-2efd7859dac9) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:46:58 user nova-compute[74836]: INFO os_vif [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:fb:b9,bridge_name='br-int',has_traffic_filtering=True,id=a4f70871-618b-47a0-a1a3-cba1cd7e806a,network=Network(e170a239-3f7a-49d7-8c73-8b66379dfc9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4f70871-61')
Nov 14 03:46:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Deleting instance files /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288_del
Nov 14 03:46:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Deletion of /opt/stack/data/nova/instances/8c388b9c-02bb-4831-9978-9101b4050288_del complete
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:46:58 user nova-compute[74836]: INFO nova.compute.manager [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 03:46:58 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:46:58 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [{"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:46:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-eb71e2c4-efba-4813-9457-cfb1a4816b06 req-2da12072-5161-4a51-b5b7-04713fc9a1a5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-deleted-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:00 user nova-compute[74836]: INFO nova.compute.manager [req-eb71e2c4-efba-4813-9457-cfb1a4816b06 req-2da12072-5161-4a51-b5b7-04713fc9a1a5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Neutron deleted interface a4f70871-618b-47a0-a1a3-cba1cd7e806a; detaching it from the instance and deleting it from the info cache
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.network.neutron [req-eb71e2c4-efba-4813-9457-cfb1a4816b06 req-2da12072-5161-4a51-b5b7-04713fc9a1a5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:00 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Took 1.34 seconds to deallocate network for instance.
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-eb71e2c4-efba-4813-9457-cfb1a4816b06 req-2da12072-5161-4a51-b5b7-04713fc9a1a5 service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Detach interface failed, port_id=a4f70871-618b-47a0-a1a3-cba1cd7e806a, reason: Instance 8c388b9c-02bb-4831-9978-9101b4050288 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] Acquiring lock "8c388b9c-02bb-4831-9978-9101b4050288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] Lock "8c388b9c-02bb-4831-9978-9101b4050288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] No waiting events found dispatching network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:00 user nova-compute[74836]: WARNING nova.compute.manager [req-05d4f0ce-3c9f-45d6-9b95-c5fc1a18d8c3 req-a3c4c8bc-9dc0-4f01-b92e-fc6a802f99ba service nova] [instance: 8c388b9c-02bb-4831-9978-9101b4050288] Received unexpected event network-vif-plugged-a4f70871-618b-47a0-a1a3-cba1cd7e806a for instance with vm_state deleted and task_state None.
Nov 14 03:47:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:00 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.816s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Deleted allocations for instance 8c388b9c-02bb-4831-9978-9101b4050288
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f3ce5eee-65f4-4b44-b34d-c08180848690 tempest-ServerStableDeviceRescueTest-996871557 tempest-ServerStableDeviceRescueTest-996871557-project-member] Lock "8c388b9c-02bb-4831-9978-9101b4050288" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.252s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance af4b1c06-4c84-469b-bf10-67a832af22b5 is timed out.
Nov 14 03:47:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance af4b1c06-4c84-469b-bf10-67a832af22b5 from the live domain config.
Nov 14 03:47:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:47:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=7468MB free_disk=24.73908233642578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdDVgbls', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:47:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d807e-2afb-4492-b780-afd112a061c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:47:03 user nova-compute[74836]: No targets found.
Nov 14 03:47:03 user nova-compute[74836]: iSNS:
Nov 14 03:47:03 user nova-compute[74836]: No targets found.
Nov 14 03:47:03 user nova-compute[74836]: STATIC:
Nov 14 03:47:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:47:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:47:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:47:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:47:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298
Nov 14 03:47:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:03 user nova-compute[74836]: FIRMWARE:
Nov 14 03:47:03 user nova-compute[74836]: No targets found.
Nov 14 03:47:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:47:03 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:47:03 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[692186e3-0cea-4155-805e-8bd376f7d265]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3b34aa-42b3-41b5-994f-ff66b4ffe8cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 (non-flash)
Nov 14 03:47:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4473b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48e0cf0-eb4f-49ed-89f0-eac364f78e37]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Applying migration context for instance 80245c74-184f-47a3-8b7f-37bea4240a7a as it has an incoming, in-progress migration 17572f18-72d1-443f-8c2e-3f47f8cf64f1. Migration status is finished {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 03:47:03 user nova-compute[74836]: INFO nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating resource usage from migration 17572f18-72d1-443f-8c2e-3f47f8cf64f1
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e03a44-97be-4682-97a0-ff713fe53ad0]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab6ab1-3f6d-4184-91a5-bc5e2268f69c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 974f1e28-ceff-4235-99d5-0c3e34273482 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance af4b1c06-4c84-469b-bf10-67a832af22b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Migration 17572f18-72d1-443f-8c2e-3f47f8cf64f1 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.063s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae1cd8b-dd3d-427d-9868-3d55167e418e]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1858694f-d70e-4cfa-ba48-d8725dc889c4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6597e7-ff9e-4c98-ad8d-db802853dc28]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260]
Nov 14 03:47:03 user nova-compute[74836]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298, portal: 172.16.0.220,3260] successful.
Nov 14 03:47:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e40cdc-a7b8-4914-a39f-f1eaf2cd4298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1e96a5-5ac9-411f-b6ee-f53635a1bcff]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== disconnect_volume: return (340ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:47:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-32657120-8543-43a6-b813-7703349ea23c tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.101s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:47:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing instance network info cache due to event network-changed-2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] Acquiring lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] Acquired lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Refreshing network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:11 user nova-compute[74836]: INFO nova.compute.manager [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Terminating instance
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updated VIF entry in instance network info cache for port 2008fbaf-1507-4dc2-9a75-d6f707b960fc. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [{"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d215c3bc-1080-4222-89cc-80f9e46cac48 req-707ab94d-79f7-4b71-a836-3f7b14d8ef75 service nova] Releasing lock "refresh_cache-a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:47:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Instance destroyed successfully.
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lazy-loading 'resources' on Instance uuid a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:40:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1888566944',display_name='tempest-TestStampPattern-server-1888566944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1888566944',id=31,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbqLVuCFKh3NQ4zl7Dy5/VsCgzLOWxlF9E7tFhcferq6k7fEjYR22kMa3Z64g8nzgyjSSdT9f5hY51hje0RR2JR3WBmb95ZW+U76IlAyOqGbgjyZLYfkr1uXLv0yaF4qQ==',key_name='tempest-TestStampPattern-200046660',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66e650c0a29644dcbbb797a589e94729',ramdisk_id='',reservation_id='r-ls992yss',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-6640805',owner_user_name='tempest-TestStampPattern-6640805-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:43:23Z,user_data=None,user_id='ed5afea1b58e4115957a8435f15ec95f',uuid=a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converting VIF {"id": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "address": "fa:16:3e:3b:64:04", "network": {"id": "e48f458a-6436-4694-a649-668087ecda6c", "bridge": "br-int", "label": "tempest-TestStampPattern-1798517615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66e650c0a29644dcbbb797a589e94729", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2008fbaf-15", "ovs_interfaceid": "2008fbaf-1507-4dc2-9a75-d6f707b960fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG os_vif [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2008fbaf-15, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc90c74d-963d-4fe8-8ad3-b6626a95b6a8) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:11 user nova-compute[74836]: INFO os_vif [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:64:04,bridge_name='br-int',has_traffic_filtering=True,id=2008fbaf-1507-4dc2-9a75-d6f707b960fc,network=Network(e48f458a-6436-4694-a649-668087ecda6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2008fbaf-15')
Nov 14 03:47:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Deleting instance files /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99_del
Nov 14 03:47:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Deletion of /opt/stack/data/nova/instances/a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99_del complete
Nov 14 03:47:12 user nova-compute[74836]: INFO nova.compute.manager [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 03:47:12 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:12 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Took 0.40 seconds to deallocate network for instance.
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-402a699d-9be9-4c12-8366-5275eee0c8c5 req-3a6b6d63-b7a9-4ee3-8e42-b523c36e213d service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-vif-deleted-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:12 user nova-compute[74836]: INFO nova.compute.manager [req-402a699d-9be9-4c12-8366-5275eee0c8c5 req-3a6b6d63-b7a9-4ee3-8e42-b523c36e213d service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Neutron deleted interface 2008fbaf-1507-4dc2-9a75-d6f707b960fc; detaching it from the instance and deleting it from the info cache
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.network.neutron [req-402a699d-9be9-4c12-8366-5275eee0c8c5 req-3a6b6d63-b7a9-4ee3-8e42-b523c36e213d service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-402a699d-9be9-4c12-8366-5275eee0c8c5 req-3a6b6d63-b7a9-4ee3-8e42-b523c36e213d service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Detach interface failed, port_id=2008fbaf-1507-4dc2-9a75-d6f707b960fc, reason: Instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:12 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Deleted allocations for instance a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-f1db29bc-d8a3-498a-a174-4e3ae92ac2f0 tempest-TestStampPattern-6640805 tempest-TestStampPattern-6640805-project-member] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.861s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-vif-unplugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] No waiting events found dispatching network-vif-unplugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:13 user nova-compute[74836]: WARNING nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received unexpected event network-vif-unplugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc for instance with vm_state deleted and task_state None.
Nov 14 03:47:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Acquiring lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] Lock "a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] No waiting events found dispatching network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:13 user nova-compute[74836]: WARNING nova.compute.manager [req-5a7c7684-baff-4e0c-8d76-ecf1ad17fff9 req-d3da7adb-4b74-425d-9991-7dd5d5f7ea51 service nova] [instance: a6ff0376-9513-4b1f-aac3-8c6f2b6ceb99] Received unexpected event network-vif-plugged-2008fbaf-1507-4dc2-9a75-d6f707b960fc for instance with vm_state deleted and task_state None.
Nov 14 03:47:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:47:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:47:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid a7546b77-9e72-491e-85cf-16f76dc01643 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 7ef95a37-bfa0-4af9-9ed8-993af09116f6 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:32 user nova-compute[74836]: INFO nova.compute.manager [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Terminating instance
Nov 14 03:47:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-unplugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] No waiting events found dispatching network-vif-unplugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-5967a9b6-ee81-40d6-8506-66c9dd9b4136 req-debb0955-eeb3-4b08-a067-9c1eb8a7a07a service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-unplugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Instance destroyed successfully.
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'resources' on Instance uuid af4b1c06-4c84-469b-bf10-67a832af22b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:44:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-699444493',display_name='tempest-AttachVolumeNegativeTest-server-699444493',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-699444493',id=38,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuE7Tu7FI/qLBSiDCi72FMZDcrXfW49mEo27gChpoxMoC1MXyBzfcfqzt4oR6551XMQPHwtItc1yBfTxNDBRetmQNUCBZHH1icsp7ToGPSDQpddue6RpXTUqT+jg/BH1w==',key_name='tempest-keypair-1365536818',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-xp81nblt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=af4b1c06-4c84-469b-bf10-67a832af22b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "address": "fa:16:3e:c4:05:40", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17dcb8cf-f8", "ovs_interfaceid": "17dcb8cf-f869-4a23-96e8-ca9d6f581b3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG os_vif [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17dcb8cf-f8, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1df6a97d-87d5-48c9-ba3c-d3e98a56cba2) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:33 user nova-compute[74836]: INFO os_vif [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:05:40,bridge_name='br-int',has_traffic_filtering=True,id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17dcb8cf-f8')
Nov 14 03:47:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Deleting instance files /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5_del
Nov 14 03:47:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Deletion of /opt/stack/data/nova/instances/af4b1c06-4c84-469b-bf10-67a832af22b5_del complete
Nov 14 03:47:33 user nova-compute[74836]: INFO nova.compute.manager [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 03:47:33 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:47:33 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:34 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Took 0.91 seconds to deallocate network for instance.
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-0ef1b145-eaee-4d43-a6ec-3181e81e17d7 req-68df8374-1d1e-479c-88ae-78596fcafa7f service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-deleted-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:34 user nova-compute[74836]: INFO nova.compute.manager [req-0ef1b145-eaee-4d43-a6ec-3181e81e17d7 req-68df8374-1d1e-479c-88ae-78596fcafa7f service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Neutron deleted interface 17dcb8cf-f869-4a23-96e8-ca9d6f581b3e; detaching it from the instance and deleting it from the info cache
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-0ef1b145-eaee-4d43-a6ec-3181e81e17d7 req-68df8374-1d1e-479c-88ae-78596fcafa7f service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-0ef1b145-eaee-4d43-a6ec-3181e81e17d7 req-68df8374-1d1e-479c-88ae-78596fcafa7f service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Detach interface failed, port_id=17dcb8cf-f869-4a23-96e8-ca9d6f581b3e, reason: Instance af4b1c06-4c84-469b-bf10-67a832af22b5 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] Acquiring lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] No waiting events found dispatching network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:34 user nova-compute[74836]: WARNING nova.compute.manager [req-f4cf627c-ca87-48cb-8b7b-87112f689f3b req-eb8ebbab-92cf-4d45-b27b-c7feae0306e7 service nova] [instance: af4b1c06-4c84-469b-bf10-67a832af22b5] Received unexpected event network-vif-plugged-17dcb8cf-f869-4a23-96e8-ca9d6f581b3e for instance with vm_state deleted and task_state None.
Nov 14 03:47:34 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Deleted allocations for instance af4b1c06-4c84-469b-bf10-67a832af22b5
Nov 14 03:47:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8bc7239f-dd91-4d54-bc99-c47ffdac58f9 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "af4b1c06-4c84-469b-bf10-67a832af22b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.439s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:36 user nova-compute[74836]: INFO nova.compute.manager [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Terminating instance
Nov 14 03:47:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-a8f982b9-3aab-46bc-b661-59a48b5950e1 req-47cf17ce-4619-4339-bd23-a1a129bdf7c6 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-unplugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:47:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Instance destroyed successfully.
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.objects.instance [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lazy-loading 'resources' on Instance uuid 07ea4caa-d030-4ca6-b716-49d37a2d7a0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-281568390',display_name='tempest-ServerRescueNegativeTestJSON-server-281568390',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-281568390',id=1,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa969498730e4839bbd15d990c31977d',ramdisk_id='',reservation_id='r-6ln573ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-57849908',owner_user_name='tempest-ServerRescueNegativeTestJSON-57849908-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:37:27Z,user_data=None,user_id='8c470afaa49c481cbf37c789908133d7',uuid=07ea4caa-d030-4ca6-b716-49d37a2d7a0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converting VIF {"id": "86d1e467-9870-48ab-9291-033f4f673003", "address": "fa:16:3e:01:ce:e3", "network": {"id": "f97caf1f-cb21-453d-983f-47356af20f7c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-898053686-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa969498730e4839bbd15d990c31977d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86d1e467-98", "ovs_interfaceid": "86d1e467-9870-48ab-9291-033f4f673003", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG os_vif [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86d1e467-98, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4af1be14-5662-4611-bafc-501f5bd919b2) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:37 user nova-compute[74836]: INFO os_vif [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:ce:e3,bridge_name='br-int',has_traffic_filtering=True,id=86d1e467-9870-48ab-9291-033f4f673003,network=Network(f97caf1f-cb21-453d-983f-47356af20f7c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86d1e467-98')
Nov 14 03:47:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Deleting instance files /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d_del
Nov 14 03:47:37 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Deletion of /opt/stack/data/nova/instances/07ea4caa-d030-4ca6-b716-49d37a2d7a0d_del complete
Nov 14 03:47:37 user nova-compute[74836]: INFO nova.compute.manager [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 03:47:37 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:47:37 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:38 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Took 0.41 seconds to deallocate network for instance.
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-93a626d5-0349-4425-a0f7-72c0fef9108a req-232320fc-171f-401b-bf58-2ca1593e91e9 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-deleted-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:38 user nova-compute[74836]: INFO nova.compute.manager [req-93a626d5-0349-4425-a0f7-72c0fef9108a req-232320fc-171f-401b-bf58-2ca1593e91e9 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Neutron deleted interface 86d1e467-9870-48ab-9291-033f4f673003; detaching it from the instance and deleting it from the info cache
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.network.neutron [req-93a626d5-0349-4425-a0f7-72c0fef9108a req-232320fc-171f-401b-bf58-2ca1593e91e9 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.compute.manager [req-93a626d5-0349-4425-a0f7-72c0fef9108a req-232320fc-171f-401b-bf58-2ca1593e91e9 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Detach interface failed, port_id=86d1e467-9870-48ab-9291-033f4f673003, reason: Instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:38 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Deleted allocations for instance 07ea4caa-d030-4ca6-b716-49d37a2d7a0d
Nov 14 03:47:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-05c00ec5-a53e-47b2-9c1d-c21ebdd17cc5 tempest-ServerRescueNegativeTestJSON-57849908 tempest-ServerRescueNegativeTestJSON-57849908-project-member] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] Acquiring lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] Lock "07ea4caa-d030-4ca6-b716-49d37a2d7a0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] No waiting events found dispatching network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:39 user nova-compute[74836]: WARNING nova.compute.manager [req-5419963d-6525-4442-9ece-9bcc44f6b35d req-968d4327-fd38-465b-8220-d122cf33d985 service nova] [instance: 07ea4caa-d030-4ca6-b716-49d37a2d7a0d] Received unexpected event network-vif-plugged-86d1e467-9870-48ab-9291-033f4f673003 for instance with vm_state deleted and task_state None.
Nov 14 03:47:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:47:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:50 user nova-compute[74836]: INFO nova.compute.manager [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Terminating instance
Nov 14 03:47:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-6d917f58-7887-46ab-9082-36156ae1a7a1 req-e6b1c9c2-3893-4fed-8448-3cd566a8d910 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-unplugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Instance destroyed successfully.
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid 974f1e28-ceff-4235-99d5-0c3e34273482 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1839081279',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1839081279',id=34,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:44:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-6g2mx4wa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:46:05Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=974f1e28-ceff-4235-99d5-0c3e34273482,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "2294d5c3-da92-4af3-bc08-654e34b222e8", "address": "fa:16:3e:39:2b:e2", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2294d5c3-da", "ovs_interfaceid": "2294d5c3-da92-4af3-bc08-654e34b222e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_vif [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2294d5c3-da, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd1b2569-e7f6-4b6e-9c9e-9cab73fd6ebf) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:51 user nova-compute[74836]: INFO os_vif [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:2b:e2,bridge_name='br-int',has_traffic_filtering=True,id=2294d5c3-da92-4af3-bc08-654e34b222e8,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2294d5c3-da')
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgRVvlTC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:47:51 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fff024-97d9-4939-9357-d486892a746e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:47:51 user nova-compute[74836]: No targets found.
Nov 14 03:47:51 user nova-compute[74836]: iSNS:
Nov 14 03:47:51 user nova-compute[74836]: No targets found.
Nov 14 03:47:51 user nova-compute[74836]: STATIC:
Nov 14 03:47:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23
Nov 14 03:47:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:47:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:47:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:47:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:51 user nova-compute[74836]: FIRMWARE:
Nov 14 03:47:51 user nova-compute[74836]: No targets found.
Nov 14 03:47:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:47:51 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:47:51 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a4d32-6d06-47a8-9f29-18fb2caf1c74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f8d91a-2374-4005-b048-31b43174b010]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:51 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43f0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23'): ({'sdf'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Removing single pathed devices sdf {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d61fb-d2c6-4ae6-b53d-9dfd0a67525d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb160164-d62c-4eb4-844d-99d24ebf8f73]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flushing IO for device /dev/sdf {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba29678-a530-496a-8e60-6e4b3a7fac7e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddd7df-1b91-467b-93d2-1142a8e5fca6]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] SCSI volumes sdf have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO19dcd78d-094d8a8478a6a966', '/dev/disk/by-id/scsi-23039346438613834', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_19dcd78d') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2886e9-2f75-40a7-941c-5f3a13956460]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f3157-f809-4456-8844-a99d199952c8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6873aec-170f-4da9-9a71-fb29fccb5041]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260]
Nov 14 03:47:51 user nova-compute[74836]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23, portal: 172.16.0.220,3260] successful.
Nov 14 03:47:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3973b6-e973-47e1-b8a0-d552af152c23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae466d61-21b7-4167-b12f-b1391995920e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== disconnect_volume: return (334ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:47:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Deleting instance files /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482_del
Nov 14 03:47:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Deletion of /opt/stack/data/nova/instances/974f1e28-ceff-4235-99d5-0c3e34273482_del complete
Nov 14 03:47:51 user nova-compute[74836]: INFO nova.compute.manager [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 03:47:51 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:47:51 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:52 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Took 0.54 seconds to deallocate network for instance.
Nov 14 03:47:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-2d35a6d8-f1e5-4a80-9df4-0088680d90fa req-8b36f68e-c64a-47e0-8771-98a1bf1ba04e service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-deleted-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] Acquiring lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] Lock "974f1e28-ceff-4235-99d5-0c3e34273482-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] No waiting events found dispatching network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:52 user nova-compute[74836]: WARNING nova.compute.manager [req-277092cc-732b-4fb2-b140-73872d38c509 req-08dffca4-2844-4798-87d9-3c00f9441292 service nova] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Received unexpected event network-vif-plugged-2294d5c3-da92-4af3-bc08-654e34b222e8 for instance with vm_state active and task_state deleting.
Nov 14 03:47:53 user nova-compute[74836]: INFO nova.compute.manager [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: 974f1e28-ceff-4235-99d5-0c3e34273482] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 03:47:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:53 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:47:53 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:47:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:53 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Deleted allocations for instance 974f1e28-ceff-4235-99d5-0c3e34273482
Nov 14 03:47:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c7b9f1be-9551-4ca8-93ef-da635e6b6382 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "974f1e28-ceff-4235-99d5-0c3e34273482" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:54 user nova-compute[74836]: INFO nova.compute.manager [None req-d150c6ea-5c48-45da-a31f-9d97bfe2a866 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Get console output
Nov 14 03:47:54 user nova-compute[74836]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 03:47:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Port b549e8cc-909f-4450-9b90-afd13379e321 binding to destination host user is already ACTIVE {{(pid=74836) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG nova.network.neutron [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Creating tmpfile /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/tmp87zc5n79 to verify with other compute node that the instance is on the same shared storage. {{(pid=74836) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:58 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:47:59 user nova-compute[74836]: WARNING nova.compute.manager [req-3c81b3f4-c3b5-4663-8615-885117fac71d req-78827af0-d416-48a6-832c-e43d889676d6 service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-unplugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state resized and task_state resize_reverting.
Nov 14 03:47:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance destroyed successfully.
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.objects.instance [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'resources' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:46:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb549e8cc-90, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac0101a5-8c16-4e31-8d1d-b08f272e0a43) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:47:59 user nova-compute[74836]: INFO os_vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:47:59 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c7e2d-e844-447e-b531-046fd7b220e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:47:59 user nova-compute[74836]: No targets found.
Nov 14 03:47:59 user nova-compute[74836]: iSNS:
Nov 14 03:47:59 user nova-compute[74836]: No targets found.
Nov 14 03:47:59 user nova-compute[74836]: STATIC:
Nov 14 03:47:59 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:47:59 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:59 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:59 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:47:59 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:59 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:59 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:47:59 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:47:59 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:47:59 user nova-compute[74836]: FIRMWARE:
Nov 14 03:47:59 user nova-compute[74836]: No targets found.
Nov 14 03:47:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:47:59 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:47:59 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c6545-2bd0-4615-a9bb-610acb48bcc8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a257996-f582-417d-a22a-aee1bda4640e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:59 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:59 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:47:59 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:47:59 user nova-compute[74836]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:47:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44bf910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[de474ad8-fabf-4504-84b9-b4e5069d2b91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a8c2ba-87d4-41e1-b3ee-8b6dae788858]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb1fda1-5951-4257-b836-3fa04ab5ab02]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b5e40c-d4c3-408e-aba3-ebef788e21b5]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a0561e-7f45-464b-b163-21a4cbb84e56]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6cd0c4-b604-4310-891a-211c244ce516]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:47:59 user nova-compute[74836]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:47:59 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5043c04-6843-418f-90b8-cc8f223fd1e1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== disconnect_volume: return (312ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:47:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [{"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.objects.instance [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'migration_context' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.objects.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Object Instance<80245c74-184f-47a3-8b7f-37bea4240a7a> lazy-loaded attributes: resources,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.325s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.066s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:48:01 user nova-compute[74836]: INFO nova.compute.manager [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Swapping old allocation on dict_keys(['9f482475-a4db-44a1-b0c2-dcf4a6aba2de']) held by migration 17572f18-72d1-443f-8c2e-3f47f8cf64f1 for instance
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Overwriting current allocation {'allocations': {'9f482475-a4db-44a1-b0c2-dcf4a6aba2de': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 47}}, 'project_id': 'e55bd47c746b472496433ecbbc6115c3', 'user_id': '6b1b556cd49347c0bca921f02527a3bf', 'consumer_generation': 1} on consumer 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:01 user nova-compute[74836]: WARNING nova.compute.manager [req-0934e2a3-6276-45ea-b0fa-6f5d69b99e4f req-25ea0172-3013-4c87-a5dd-efa333f54a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state resized and task_state resize_reverting.
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG os_brick.utils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[17781abc-db81-445b-8ab8-cd7d619987ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b300a1a-5b5b-434c-ae23-9e293aa6b11c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:01 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1928363-1221-49e7-bbc2-fc329af6f427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebba635e-d989-45af-8252-e4e430451b75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:48:02 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9aaaa96-82cf-4637-8fea-4192c0e7de2c]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG os_brick.utils [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8227MB free_disk=24.88882064819336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance a7546b77-9e72-491e-85cf-16f76dc01643 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:48:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Starting finish_revert_migration {{(pid=74836) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start _get_guest_xml network_info=[{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '80245c74-184f-47a3-8b7f-37bea4240a7a', 'attached_at': '2023-11-14T03:48:07.000000', 'detached_at': '', 'volume_id': '5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'serial': '5b6b8b23-4c1c-4b88-b9ac-d708d9e48227'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '9fe77aca-5b91-4e07-a016-8b8a0bfd3571', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:48:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.objects.instance [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'vcpu_model' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:48:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:48:06 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:48:06 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb73664-3ad7-4de8-a692-74a91052a937]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:48:06 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cc58cb-a885-497d-9ed1-b0123a676053]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227] added
Nov 14 03:48:06 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e375d08e-de03-4c87-b50b-44b327cba858]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80097d-3c66-42af-b0a9-4d689038cf67]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AHcVMSoO" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7005b2b7-7c58-414b-a2f7-beea608eaf2f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AHcVMSoO'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5e2dd2-ac45-498c-9ea1-b492cba23898]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[152fd400-0f0a-4093-b01d-6a51dfb98a45]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f53b33a-1fb4-4f59-90d0-e6986fee05ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:48:07 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:48:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b1894-d7b8-49e5-a79f-3a3b164698e4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78483c38-b397-4f1b-8bea-d4880b41d758]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:07 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fcb002-e97a-4b9f-ad11-ca7064fb0f28]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531663465356531', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:48:08 user nova-compute[74836]:   <uuid>80245c74-184f-47a3-8b7f-37bea4240a7a</uuid>
Nov 14 03:48:08 user nova-compute[74836]:   <name>instance-00000021</name>
Nov 14 03:48:08 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:48:08 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:48:08 user nova-compute[74836]:   <metadata>
Nov 14 03:48:08 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:48:08 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:name>tempest-ServerActionsTestOtherB-server-2077651375</nova:name>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:48:06</nova:creationTime>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:48:08 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:48:08 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:owner>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:user uuid="6b1b556cd49347c0bca921f02527a3bf">tempest-ServerActionsTestOtherB-1529116963-project-member</nova:user>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:project uuid="e55bd47c746b472496433ecbbc6115c3">tempest-ServerActionsTestOtherB-1529116963</nova:project>
Nov 14 03:48:08 user nova-compute[74836]:       </nova:owner>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:48:08 user nova-compute[74836]:       <nova:ports>
Nov 14 03:48:08 user nova-compute[74836]:         <nova:port uuid="b549e8cc-909f-4450-9b90-afd13379e321">
Nov 14 03:48:08 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 03:48:08 user nova-compute[74836]:         </nova:port>
Nov 14 03:48:08 user nova-compute[74836]:       </nova:ports>
Nov 14 03:48:08 user nova-compute[74836]:     </nova:instance>
Nov 14 03:48:08 user nova-compute[74836]:   </metadata>
Nov 14 03:48:08 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:48:08 user nova-compute[74836]:     <system>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="serial">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="uuid">80245c74-184f-47a3-8b7f-37bea4240a7a</entry>
Nov 14 03:48:08 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:48:08 user nova-compute[74836]:     </system>
Nov 14 03:48:08 user nova-compute[74836]:   </sysinfo>
Nov 14 03:48:08 user nova-compute[74836]:   <os>
Nov 14 03:48:08 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:48:08 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:48:08 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:48:08 user nova-compute[74836]:   </os>
Nov 14 03:48:08 user nova-compute[74836]:   <features>
Nov 14 03:48:08 user nova-compute[74836]:     <acpi/>
Nov 14 03:48:08 user nova-compute[74836]:     <apic/>
Nov 14 03:48:08 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:48:08 user nova-compute[74836]:   </features>
Nov 14 03:48:08 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:48:08 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:48:08 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:48:08 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:48:08 user nova-compute[74836]:   </clock>
Nov 14 03:48:08 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:48:08 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:48:08 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:48:08 user nova-compute[74836]:   </cpu>
Nov 14 03:48:08 user nova-compute[74836]:   <devices>
Nov 14 03:48:08 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:48:08 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:48:08 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk"/>
Nov 14 03:48:08 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:48:08 user nova-compute[74836]:     </disk>
Nov 14 03:48:08 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:48:08 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:48:08 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:48:08 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:48:08 user nova-compute[74836]:       <serial>5b6b8b23-4c1c-4b88-b9ac-d708d9e48227</serial>
Nov 14 03:48:08 user nova-compute[74836]:     </disk>
Nov 14 03:48:08 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:48:08 user nova-compute[74836]:       <mac address="fa:16:3e:dd:69:0b"/>
Nov 14 03:48:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:08 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:48:08 user nova-compute[74836]:       <target dev="tapb549e8cc-90"/>
Nov 14 03:48:08 user nova-compute[74836]:     </interface>
Nov 14 03:48:08 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:48:08 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/console.log" append="off"/>
Nov 14 03:48:08 user nova-compute[74836]:     </serial>
Nov 14 03:48:08 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:48:08 user nova-compute[74836]:     <video>
Nov 14 03:48:08 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:08 user nova-compute[74836]:     </video>
Nov 14 03:48:08 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:48:08 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:48:08 user nova-compute[74836]:     </rng>
Nov 14 03:48:08 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:48:08 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:48:08 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:48:08 user nova-compute[74836]:     </memballoon>
Nov 14 03:48:08 user nova-compute[74836]:   </devices>
Nov 14 03:48:08 user nova-compute[74836]: </domain>
Nov 14 03:48:08 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG os_vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae9ba8a6-8699-5051-a104-1a2bf7e8eae8', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb549e8cc-90, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb549e8cc-90, col_values=(('qos', UUID('6a5aa4ee-c427-472c-8c8c-60260f749188')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb549e8cc-90, col_values=(('external_ids', {'iface-id': 'b549e8cc-909f-4450-9b90-afd13379e321', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:69:0b', 'vm-uuid': '80245c74-184f-47a3-8b7f-37bea4240a7a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:08 user nova-compute[74836]: INFO os_vif [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:48:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:09 user nova-compute[74836]: WARNING nova.compute.manager [req-fee1fccc-2818-43c6-a39c-5629879ea170 req-7c9479c8-7560-4329-9345-03e2a1454a7a service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state resized and task_state resize_reverting.
Nov 14 03:48:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:48:11 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance running successfully.
Nov 14 03:48:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] finish_revert_migration finished successfully. {{(pid=74836) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] No waiting events found dispatching network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:11 user nova-compute[74836]: WARNING nova.compute.manager [req-cd5ac026-0eb5-404b-a9c1-58ddff33406a req-622c2987-cc49-4505-9784-81b928bc0fba service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received unexpected event network-vif-plugged-b549e8cc-909f-4450-9b90-afd13379e321 for instance with vm_state resized and task_state resize_reverting.
Nov 14 03:48:11 user nova-compute[74836]: INFO nova.compute.manager [None req-55e30be4-1470-4b7a-af95-c2cd49cd1670 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance to original state: 'active'
Nov 14 03:48:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:26 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:48:26 user nova-compute[74836]: INFO nova.compute.claims [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Claim successful on node user
Nov 14 03:48:26 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:48:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.policy [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3983545cf6a4d46858c309b90436dcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6087e90cb4f047b089b12a1e35e125ed', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:48:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Creating image(s)
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "/opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk 1073741824" returned: 0 in 0.049s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:27 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Successfully created port: 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Cannot resize image /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Ensure instance console log exists: /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Successfully updated port: 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquired lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-changed-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Refreshing instance network info cache due to event network-changed-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] Acquiring lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:28 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.neutron [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating instance_info_cache with network_info: [{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Releasing lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Instance network_info: |[{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] Acquired lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.neutron [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Refreshing network info cache for port 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Start _get_guest_xml network_info=[{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:48:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96512077',display_name='tempest-AttachVolumeNegativeTest-server-96512077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-96512077',id=40,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoGKUO729QOjH0cfmPIGHslHmgnC2Bd8KkDOb0yRqee63zTw83r8ddfGPCNclJS1zE7Rc0LrK7eokPR1GDEZqjS7SeSN2QW3IHx0ntOdyuCt53gtEq70/5yAGp1s+psQg==',key_name='tempest-keypair-671280961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-dsj5xuxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=ab7919ca-8573-46f9-a7db-57c312b6c0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'pci_devices' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:48:29 user nova-compute[74836]:   <uuid>ab7919ca-8573-46f9-a7db-57c312b6c0da</uuid>
Nov 14 03:48:29 user nova-compute[74836]:   <name>instance-00000028</name>
Nov 14 03:48:29 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:48:29 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:48:29 user nova-compute[74836]:   <metadata>
Nov 14 03:48:29 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:48:29 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeNegativeTest-server-96512077</nova:name>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:48:29</nova:creationTime>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:48:29 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:48:29 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:owner>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:user uuid="a3983545cf6a4d46858c309b90436dcd">tempest-AttachVolumeNegativeTest-1016966726-project-member</nova:user>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:project uuid="6087e90cb4f047b089b12a1e35e125ed">tempest-AttachVolumeNegativeTest-1016966726</nova:project>
Nov 14 03:48:29 user nova-compute[74836]:       </nova:owner>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:48:29 user nova-compute[74836]:       <nova:ports>
Nov 14 03:48:29 user nova-compute[74836]:         <nova:port uuid="4be07cc3-6ebf-429f-987f-af8dc5e0ce6d">
Nov 14 03:48:29 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:48:29 user nova-compute[74836]:         </nova:port>
Nov 14 03:48:29 user nova-compute[74836]:       </nova:ports>
Nov 14 03:48:29 user nova-compute[74836]:     </nova:instance>
Nov 14 03:48:29 user nova-compute[74836]:   </metadata>
Nov 14 03:48:29 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:48:29 user nova-compute[74836]:     <system>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="serial">ab7919ca-8573-46f9-a7db-57c312b6c0da</entry>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="uuid">ab7919ca-8573-46f9-a7db-57c312b6c0da</entry>
Nov 14 03:48:29 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:48:29 user nova-compute[74836]:     </system>
Nov 14 03:48:29 user nova-compute[74836]:   </sysinfo>
Nov 14 03:48:29 user nova-compute[74836]:   <os>
Nov 14 03:48:29 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:48:29 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:48:29 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:48:29 user nova-compute[74836]:   </os>
Nov 14 03:48:29 user nova-compute[74836]:   <features>
Nov 14 03:48:29 user nova-compute[74836]:     <acpi/>
Nov 14 03:48:29 user nova-compute[74836]:     <apic/>
Nov 14 03:48:29 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:48:29 user nova-compute[74836]:   </features>
Nov 14 03:48:29 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:48:29 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:48:29 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:48:29 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:48:29 user nova-compute[74836]:   </clock>
Nov 14 03:48:29 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:48:29 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:48:29 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:48:29 user nova-compute[74836]:   </cpu>
Nov 14 03:48:29 user nova-compute[74836]:   <devices>
Nov 14 03:48:29 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:48:29 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:48:29 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk"/>
Nov 14 03:48:29 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:48:29 user nova-compute[74836]:     </disk>
Nov 14 03:48:29 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:48:29 user nova-compute[74836]:       <mac address="fa:16:3e:e0:e4:fe"/>
Nov 14 03:48:29 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:29 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:48:29 user nova-compute[74836]:       <target dev="tap4be07cc3-6e"/>
Nov 14 03:48:29 user nova-compute[74836]:     </interface>
Nov 14 03:48:29 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:48:29 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/console.log" append="off"/>
Nov 14 03:48:29 user nova-compute[74836]:     </serial>
Nov 14 03:48:29 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:48:29 user nova-compute[74836]:     <video>
Nov 14 03:48:29 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:29 user nova-compute[74836]:     </video>
Nov 14 03:48:29 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:48:29 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:48:29 user nova-compute[74836]:     </rng>
Nov 14 03:48:29 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:48:29 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:48:29 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:48:29 user nova-compute[74836]:     </memballoon>
Nov 14 03:48:29 user nova-compute[74836]:   </devices>
Nov 14 03:48:29 user nova-compute[74836]: </domain>
Nov 14 03:48:29 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96512077',display_name='tempest-AttachVolumeNegativeTest-server-96512077',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-96512077',id=40,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoGKUO729QOjH0cfmPIGHslHmgnC2Bd8KkDOb0yRqee63zTw83r8ddfGPCNclJS1zE7Rc0LrK7eokPR1GDEZqjS7SeSN2QW3IHx0ntOdyuCt53gtEq70/5yAGp1s+psQg==',key_name='tempest-keypair-671280961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-dsj5xuxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:48:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=ab7919ca-8573-46f9-a7db-57c312b6c0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG os_vif [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b8d2755f-3950-5b5c-802e-9f904cc1eaee', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4be07cc3-6e, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4be07cc3-6e, col_values=(('qos', UUID('12dac848-4395-4013-bdb6-45bfd4c78e02')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4be07cc3-6e, col_values=(('external_ids', {'iface-id': '4be07cc3-6ebf-429f-987f-af8dc5e0ce6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e4:fe', 'vm-uuid': 'ab7919ca-8573-46f9-a7db-57c312b6c0da'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:29 user nova-compute[74836]: INFO os_vif [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e')
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:48:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:e0:e4:fe, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG nova.network.neutron [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updated VIF entry in instance network info cache for port 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG nova.network.neutron [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating instance_info_cache with network_info: [{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6b55391f-8c9a-4fb4-999e-81a6fbf8b651 req-23e1a730-47f8-44bf-a470-515603d3b22b service nova] Releasing lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG nova.compute.manager [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] No waiting events found dispatching network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:31 user nova-compute[74836]: WARNING nova.compute.manager [req-fb04abf3-9bba-4b55-8882-c3a60a1d0bb0 req-65b7564d-d575-4e69-8777-cb2614172e9d service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received unexpected event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d for instance with vm_state building and task_state spawning.
Nov 14 03:48:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:48:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Instance spawned successfully.
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] No waiting events found dispatching network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:33 user nova-compute[74836]: WARNING nova.compute.manager [req-97f544c7-8ee8-4bdd-b900-f0aa64f68a7f req-98e3a269-61fb-4df6-b764-4e380e7c6c7e service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received unexpected event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d for instance with vm_state building and task_state spawning.
Nov 14 03:48:33 user nova-compute[74836]: INFO nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 14 03:48:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:48:33 user nova-compute[74836]: INFO nova.compute.manager [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Took 6.75 seconds to build instance.
Nov 14 03:48:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9daa83d3-3876-47d3-8738-ca74ffa8e542 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.856s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG nova.compute.manager [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing instance network info cache due to event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:36 user nova-compute[74836]: DEBUG nova.network.neutron [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:48:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updated VIF entry in instance network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:48:37 user nova-compute[74836]: DEBUG nova.network.neutron [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d96109d7-20b3-42f2-9101-55123b3aaa67 req-1fffa010-8cbe-4ce4-a5c5-98370472d934 service nova] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:39 user nova-compute[74836]: INFO nova.compute.manager [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Shelving
Nov 14 03:48:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance destroyed successfully.
Nov 14 03:48:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Beginning cold snapshot process
Nov 14 03:48:40 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:48:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk /opt/stack/data/nova/instances/snapshots/tmp6o9p2lfr/a74ec33b83c14e61b0c95ecbca6189d0 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:41 user nova-compute[74836]: WARNING nova.compute.manager [req-9b0f0f30-aace-4a8a-8e8a-1f0d72261f1e req-0594e25b-3856-4453-83ca-b9d2ba85b654 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:41 user nova-compute[74836]: INFO nova.compute.manager [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Terminating instance
Nov 14 03:48:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk /opt/stack/data/nova/instances/snapshots/tmp6o9p2lfr/a74ec33b83c14e61b0c95ecbca6189d0" returned: 0 in 1.012s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Snapshot extracted, beginning image upload
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Instance destroyed successfully.
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid a7546b77-9e72-491e-85cf-16f76dc01643 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1343847800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1343847800',id=27,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-wms6fmzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:41:15Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=a7546b77-9e72-491e-85cf-16f76dc01643,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "3bf22994-c98b-49dd-ad11-0630cf736de7", "address": "fa:16:3e:c5:38:9d", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3bf22994-c9", "ovs_interfaceid": "3bf22994-c98b-49dd-ad11-0630cf736de7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG os_vif [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3bf22994-c9, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8d1de20-95ec-4b95-9095-bb153f7cb9a6) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:42 user nova-compute[74836]: INFO os_vif [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:38:9d,bridge_name='br-int',has_traffic_filtering=True,id=3bf22994-c98b-49dd-ad11-0630cf736de7,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3bf22994-c9')
Nov 14 03:48:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Deleting instance files /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643_del
Nov 14 03:48:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Deletion of /opt/stack/data/nova/instances/a7546b77-9e72-491e-85cf-16f76dc01643_del complete
Nov 14 03:48:42 user nova-compute[74836]: INFO nova.compute.manager [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 03:48:42 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:48:42 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:43 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Took 0.43 seconds to deallocate network for instance.
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-fa7f3bd1-5870-4629-a084-599facdde4d2 req-a2e6e094-6380-4694-b931-3988174b5167 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-vif-deleted-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:43 user nova-compute[74836]: WARNING nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-vif-unplugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] No waiting events found dispatching network-vif-unplugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:43 user nova-compute[74836]: WARNING nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received unexpected event network-vif-unplugged-3bf22994-c98b-49dd-ad11-0630cf736de7 for instance with vm_state deleted and task_state None.
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Acquiring lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] Lock "a7546b77-9e72-491e-85cf-16f76dc01643-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] No waiting events found dispatching network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:43 user nova-compute[74836]: WARNING nova.compute.manager [req-eca89bb4-2989-4123-b45a-03486ec7d86d req-11377e3f-568e-4177-ac35-58a189126006 service nova] [instance: a7546b77-9e72-491e-85cf-16f76dc01643] Received unexpected event network-vif-plugged-3bf22994-c98b-49dd-ad11-0630cf736de7 for instance with vm_state deleted and task_state None.
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:43 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Deleted allocations for instance a7546b77-9e72-491e-85cf-16f76dc01643
Nov 14 03:48:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3b84a9ad-063b-4b6d-806d-ef23a3baf447 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "a7546b77-9e72-491e-85cf-16f76dc01643" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Snapshot image upload complete
Nov 14 03:48:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:48:44 user nova-compute[74836]: INFO nova.compute.manager [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Shelve offloading
Nov 14 03:48:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance destroyed successfully.
Nov 14 03:48:44 user nova-compute[74836]: DEBUG nova.compute.manager [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:48:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance destroyed successfully.
Nov 14 03:48:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'resources' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORHWbQGrZhoOBMY+RQqVARDHoLUtY5oX2mi+ndlT1uBJJVa9hR++fbH3dCDNps/REcq5GElrm8bO8FEOlBI3PraJA2TYTEos1cHpMTFMr1NBIdyti6zR8LtH0GOirqkYQ==',key_name='tempest-keypair-1425264219',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:48:44.702286',shelved_host='user',shelved_image_id='f66cc5f6-1f11-4293-9c3a-6f0def53775c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:48:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG os_vif [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c479662-53, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.compute.manager [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing instance network info cache due to event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bb9170e-743c-4f20-8e3a-23cb4186fda6) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:46 user nova-compute[74836]: INFO os_vif [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53')
Nov 14 03:48:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Deleting instance files /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4_del
Nov 14 03:48:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Deletion of /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4_del complete
Nov 14 03:48:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:46 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Deleted allocations for instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'numa_topology' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.objects.base [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<db4cbd53-aabe-4b4c-9fc2-65a593d301d4> lazy-loaded attributes: resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updated VIF entry in instance network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2c479662-53", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-25cdda3f-a24a-4a69-8591-fea8e32aca14 req-62b0892e-ba41-42a1-ab16-fd1538e38ff0 service nova] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-64a928b0-34d0-46c0-97da-df057b7c497b tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.902s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:48 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:48:48 user nova-compute[74836]: INFO nova.compute.claims [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Claim successful on node user
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:48:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.policy [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7ec589b1f8c4a7b888e2a4c6b6be9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2824a9ddbc86494d891293a862669345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:48:49 user nova-compute[74836]: INFO nova.virt.block_device [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Booting with volume fa98fcbd-e0ed-428b-957a-18296955bc61 at /dev/vda
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.utils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a53f58-72df-461f-8039-f3e8cd63f783]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6e16a5-c6a9-4bf1-ac25-f2666ba03017]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[809e39eb-dc50-4861-b39d-d11f4b99311a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[518984da-8a28-4520-a6ae-e6019551e54c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:48:49 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:48:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8672002f-04a2-46cf-acfa-e38466ccb740]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG os_brick.utils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating existing volume attachment record: 54225919-38e7-4bae-9129-6adfadadbea0 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:48:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Successfully created port: c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Successfully updated port: c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing instance network info cache due to event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:48:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance network_info: |[{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updated VIF entry in instance network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-18448869-2c8e-4798-8a2d-abfc44cc019b req-a26d51e3-f393-4035-97c3-f1585f2f8e3e service nova] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:48:54 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Creating image(s)
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Ensure instance console log exists: /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start _get_guest_xml network_info=[{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0009e5c8-f604-4057-9d64-d2c0297da6f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa98fcbd-e0ed-428b-957a-18296955bc61', 'serial': 'fa98fcbd-e0ed-428b-957a-18296955bc61'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '54225919-38e7-4bae-9129-6adfadadbea0', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:48:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:48:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:48:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:48:54 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b93d324-abb7-43aa-8efa-4a0a458b3483]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:48:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f045c7-8b66-4593-ae68-8a3b340a449a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61] added
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.098s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[29151238-4bb4-4937-beba-8a6ff364db3c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2382e3-7be6-4cbc-b9d9-3cd2952b44c8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMvnESTj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMvnESTj" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1f5984-4f5d-4ee2-87ee-1a5de519b53f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMvnESTj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a85c0-d2ad-48b5-9a19-10037859a30e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b9181-e15b-46de-9784-6cc151617d26]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1490e5a5-cdbf-404f-a964-1470d36348f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]
Nov 14 03:48:54 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c71b99-e144-40e2-8c66-03f6530c9347]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e931f87-c8e8-4ba5-900c-b35fb9a1f7d9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:48:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e370fa0-6ecb-44d0-83fe-b1ad19d5f6bd]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:48:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '23334316239373131', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334316239373131', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:55 user nova-compute[74836]: INFO nova.compute.manager [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Terminating instance
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.compute.manager [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGB9kXXZI7btlYKz8qbwCl5qSXx9ePbigaOlVqmnu3Yul5a2sIXzX3Dv0gw8CgASpq/3OhHy3FGVm1xv2CUZ2zpOM8sMMCUsBy/v1w/eT9080f+Qu1oE7h+PZIPBd+H8w==',key_name='tempest-TestShelveInstance-259864335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:48:49Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'pci_devices' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:48:55 user nova-compute[74836]:   <uuid>0009e5c8-f604-4057-9d64-d2c0297da6f3</uuid>
Nov 14 03:48:55 user nova-compute[74836]:   <name>instance-00000029</name>
Nov 14 03:48:55 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:48:55 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:48:55 user nova-compute[74836]:   <metadata>
Nov 14 03:48:55 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:48:55 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:48:55 user nova-compute[74836]:       <nova:name>tempest-TestShelveInstance-server-470281484</nova:name>
Nov 14 03:48:55 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:48:54</nova:creationTime>
Nov 14 03:48:55 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:48:55 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:48:55 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:48:55 user nova-compute[74836]:       <nova:owner>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:user uuid="e7ec589b1f8c4a7b888e2a4c6b6be9de">tempest-TestShelveInstance-1788421859-project-member</nova:user>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:project uuid="2824a9ddbc86494d891293a862669345">tempest-TestShelveInstance-1788421859</nova:project>
Nov 14 03:48:55 user nova-compute[74836]:       </nova:owner>
Nov 14 03:48:55 user nova-compute[74836]:       <nova:ports>
Nov 14 03:48:55 user nova-compute[74836]:         <nova:port uuid="c8abca67-51cb-49ec-8ac7-2e1bd18c6792">
Nov 14 03:48:55 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:48:55 user nova-compute[74836]:         </nova:port>
Nov 14 03:48:55 user nova-compute[74836]:       </nova:ports>
Nov 14 03:48:55 user nova-compute[74836]:     </nova:instance>
Nov 14 03:48:55 user nova-compute[74836]:   </metadata>
Nov 14 03:48:55 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:48:55 user nova-compute[74836]:     <system>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="serial">0009e5c8-f604-4057-9d64-d2c0297da6f3</entry>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="uuid">0009e5c8-f604-4057-9d64-d2c0297da6f3</entry>
Nov 14 03:48:55 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:48:55 user nova-compute[74836]:     </system>
Nov 14 03:48:55 user nova-compute[74836]:   </sysinfo>
Nov 14 03:48:55 user nova-compute[74836]:   <os>
Nov 14 03:48:55 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:48:55 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:48:55 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:48:55 user nova-compute[74836]:   </os>
Nov 14 03:48:55 user nova-compute[74836]:   <features>
Nov 14 03:48:55 user nova-compute[74836]:     <acpi/>
Nov 14 03:48:55 user nova-compute[74836]:     <apic/>
Nov 14 03:48:55 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:48:55 user nova-compute[74836]:   </features>
Nov 14 03:48:55 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:48:55 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:48:55 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:48:55 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:48:55 user nova-compute[74836]:   </clock>
Nov 14 03:48:55 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:48:55 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:48:55 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:48:55 user nova-compute[74836]:   </cpu>
Nov 14 03:48:55 user nova-compute[74836]:   <devices>
Nov 14 03:48:55 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:48:55 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:48:55 user nova-compute[74836]:       <source dev="/dev/sdd"/>
Nov 14 03:48:55 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:48:55 user nova-compute[74836]:       <serial>fa98fcbd-e0ed-428b-957a-18296955bc61</serial>
Nov 14 03:48:55 user nova-compute[74836]:     </disk>
Nov 14 03:48:55 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:48:55 user nova-compute[74836]:       <mac address="fa:16:3e:54:35:d0"/>
Nov 14 03:48:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:55 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:48:55 user nova-compute[74836]:       <target dev="tapc8abca67-51"/>
Nov 14 03:48:55 user nova-compute[74836]:     </interface>
Nov 14 03:48:55 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:48:55 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3/console.log" append="off"/>
Nov 14 03:48:55 user nova-compute[74836]:     </serial>
Nov 14 03:48:55 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:48:55 user nova-compute[74836]:     <video>
Nov 14 03:48:55 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:48:55 user nova-compute[74836]:     </video>
Nov 14 03:48:55 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:48:55 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:48:55 user nova-compute[74836]:     </rng>
Nov 14 03:48:55 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:48:55 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:48:55 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:48:55 user nova-compute[74836]:     </memballoon>
Nov 14 03:48:55 user nova-compute[74836]:   </devices>
Nov 14 03:48:55 user nova-compute[74836]: </domain>
Nov 14 03:48:55 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGB9kXXZI7btlYKz8qbwCl5qSXx9ePbigaOlVqmnu3Yul5a2sIXzX3Dv0gw8CgASpq/3OhHy3FGVm1xv2CUZ2zpOM8sMMCUsBy/v1w/eT9080f+Qu1oE7h+PZIPBd+H8w==',key_name='tempest-TestShelveInstance-259864335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:48:49Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG os_vif [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1662a88-30a8-5667-ac4b-08909494455a', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8abca67-51, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8abca67-51, col_values=(('qos', UUID('4fd434a8-4d20-4872-9ecc-4fbda91d4466')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8abca67-51, col_values=(('external_ids', {'iface-id': 'c8abca67-51cb-49ec-8ac7-2e1bd18c6792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:35:d0', 'vm-uuid': '0009e5c8-f604-4057-9d64-d2c0297da6f3'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:55 user nova-compute[74836]: INFO os_vif [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51')
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] No VIF found with MAC fa:16:3e:54:35:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-f5155656-db14-4e84-b393-832108bf6929 req-05a096a1-0d47-45e3-89df-2fecbd61e856 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-unplugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:48:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Instance destroyed successfully.
Nov 14 03:48:56 user nova-compute[74836]: DEBUG nova.objects.instance [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'resources' on Instance uuid 7ef95a37-bfa0-4af9-9ed8-993af09116f6 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1028770785',display_name='tempest-ServerActionsTestOtherA-server-1028770785',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1028770785',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:44:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-7h3fy52t',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:46:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=7ef95a37-bfa0-4af9-9ed8-993af09116f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "address": "fa:16:3e:ed:09:e5", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbefd00c-ed", "ovs_interfaceid": "bbefd00c-ed80-4225-b8a2-fb748de8ff46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_vif [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbefd00c-ed, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ddf6890-b626-4c3e-beca-fb7b2feddf14) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:56 user nova-compute[74836]: INFO os_vif [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:09:e5,bridge_name='br-int',has_traffic_filtering=True,id=bbefd00c-ed80-4225-b8a2-fb748de8ff46,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbefd00c-ed')
Nov 14 03:48:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jNSDozwl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:48:56 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa00e57-d8f1-4206-92e7-44873592338a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:48:56 user nova-compute[74836]: No targets found.
Nov 14 03:48:56 user nova-compute[74836]: iSNS:
Nov 14 03:48:56 user nova-compute[74836]: No targets found.
Nov 14 03:48:56 user nova-compute[74836]: STATIC:
Nov 14 03:48:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61
Nov 14 03:48:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:48:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:48:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:48:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:48:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:48:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa
Nov 14 03:48:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:48:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:48:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:48:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:48:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:48:56 user nova-compute[74836]: FIRMWARE:
Nov 14 03:48:56 user nova-compute[74836]: No targets found.
Nov 14 03:48:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:48:56 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:48:56 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88e15ae-b84b-4c73-b9cb-4aa3eda2a378]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f77627-00f2-477b-9727-a9b2b8fa8386]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:48:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4374d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa'): ({'sdg'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Removing single pathed devices sdg {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca89f3ce-ced0-4c91-8bbf-594118773760]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe43fb89-90f3-4def-b57a-a3c1329a7764]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Flushing IO for device /dev/sdg {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:48:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d3fb76-4a84-4a62-9296-a34ef9701f74]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c8c84-9e67-4285-bd58-aede1d6607b1]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] SCSI volumes sdg have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[37921b49-e0a6-4ac7-86ed-76a00f3e7192]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[581331ef-b53f-41f6-83a4-792287227bd6]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260]
Nov 14 03:48:57 user nova-compute[74836]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa, portal: 172.16.0.220,3260] successful.
Nov 14 03:48:57 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a25e4-7988-409f-8914-30ed7042d462]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] <== disconnect_volume: return (334ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:48:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Deleting instance files /opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6_del
Nov 14 03:48:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Deletion of /opt/stack/data/nova/instances/7ef95a37-bfa0-4af9-9ed8-993af09116f6_del complete
Nov 14 03:48:57 user nova-compute[74836]: INFO nova.compute.manager [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Took 1.69 seconds to destroy the instance on the hypervisor.
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Acquiring lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] No waiting events found dispatching network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:57 user nova-compute[74836]: WARNING nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received unexpected event network-vif-plugged-bbefd00c-ed80-4225-b8a2-fb748de8ff46 for instance with vm_state active and task_state deleting.
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:57 user nova-compute[74836]: WARNING nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state building and task_state spawning.
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:48:57 user nova-compute[74836]: WARNING nova.compute.manager [req-3f6132f3-e316-47b7-a94c-dab083f686bd req-6f593fd7-04be-44a3-9b48-d9bcdd1cf42f service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state building and task_state spawning.
Nov 14 03:48:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:48:58 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:48:58 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Took 0.98 seconds to deallocate network for instance.
Nov 14 03:48:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-748063e1-5361-4c1e-933a-e65c15ef6784 req-59a3c35e-dfbc-4805-9ab6-020c9ff45a98 service nova] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Received event network-vif-deleted-bbefd00c-ed80-4225-b8a2-fb748de8ff46 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:48:59 user nova-compute[74836]: INFO nova.compute.manager [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 7ef95a37-bfa0-4af9-9ed8-993af09116f6] Deleting volume: 3c0e6710-00a1-4eb9-9bd5-ccbd889d9bfa {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:59 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Deleted allocations for instance 7ef95a37-bfa0-4af9-9ed8-993af09116f6
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-deab7e5c-d421-4eff-bb9d-9157743c0064 tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "7ef95a37-bfa0-4af9-9ed8-993af09116f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.025s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:48:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance spawned successfully.
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:48:59 user nova-compute[74836]: INFO nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 14 03:48:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:48:59 user nova-compute[74836]: INFO nova.compute.manager [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Took 11.16 seconds to build instance.
Nov 14 03:48:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a5c3c682-33df-4782-b8b7-225ea51e5c9b tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.248s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:00 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [{"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-80245c74-184f-47a3-8b7f-37bea4240a7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:01 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:02 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:49:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8271MB free_disk=24.953754425048828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance ab7919ca-8573-46f9-a7db-57c312b6c0da actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0009e5c8-f604-4057-9d64-d2c0297da6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:49:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:07 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:32 user nova-compute[74836]: INFO nova.compute.manager [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Terminating instance
Nov 14 03:49:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-e5729f58-13cb-49f9-89be-5fcf5c5e121a req-a188c6ba-3c72-4afe-96bf-f7bc89b07557 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-unplugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Instance destroyed successfully.
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:33:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1784073350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1784073350',id=15,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:35:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-vlp9ukwf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:37:31Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "address": "fa:16:3e:54:0b:4f", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778fc191-db", "ovs_interfaceid": "778fc191-dbfd-4ee5-8a9f-4ca3c4679804", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_vif [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap778fc191-db, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7452daf9-ba8c-4b0c-ba4a-afe320feb133) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:49:33 user nova-compute[74836]: INFO os_vif [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:0b:4f,bridge_name='br-int',has_traffic_filtering=True,id=778fc191-dbfd-4ee5-8a9f-4ca3c4679804,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778fc191-db')
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOJKfspj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:49:33 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[417ec94f-8258-4b72-898d-a624535bcab6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:49:33 user nova-compute[74836]: No targets found.
Nov 14 03:49:33 user nova-compute[74836]: iSNS:
Nov 14 03:49:33 user nova-compute[74836]: No targets found.
Nov 14 03:49:33 user nova-compute[74836]: STATIC:
Nov 14 03:49:33 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61
Nov 14 03:49:33 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:49:33 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:49:33 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:49:33 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:49:33 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:49:33 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749
Nov 14 03:49:33 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:49:33 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:49:33 user nova-compute[74836]: FIRMWARE:
Nov 14 03:49:33 user nova-compute[74836]: No targets found.
Nov 14 03:49:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:49:33 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:49:33 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36746b47-8c80-418b-8625-cb2389132081]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5b14a-75b7-4759-a53e-d20839df127a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:49:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4375240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[338bc02f-83e5-4af3-bb0b-5215faf0fcfb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5d7f9-6ad0-4806-92e7-c0239303dfce]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2307b8e4-202e-4231-bd5a-4db77560eecc]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[97711677-860a-4ae5-b922-b2c892183719]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dffd87-b8ba-488e-a7c1-463b0ca37bcd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[547663ab-4c11-41db-9238-76df110b2b7e]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260]
Nov 14 03:49:33 user nova-compute[74836]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749, portal: 172.16.0.220,3260] successful.
Nov 14 03:49:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3bdddb8-7fcc-48b4-9cab-0e0c66a34749 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bec2658-9e08-47fe-866c-36e681008a3c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] <== disconnect_volume: return (317ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:49:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Deleting instance files /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d_del
Nov 14 03:49:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Deletion of /opt/stack/data/nova/instances/cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d_del complete
Nov 14 03:49:33 user nova-compute[74836]: INFO nova.compute.manager [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 03:49:33 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:49:33 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:49:34 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:49:34 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Took 0.69 seconds to deallocate network for instance.
Nov 14 03:49:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] Acquiring lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] No waiting events found dispatching network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:34 user nova-compute[74836]: WARNING nova.compute.manager [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received unexpected event network-vif-plugged-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 for instance with vm_state active and task_state deleting.
Nov 14 03:49:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-a379b666-f869-42ba-9b3b-90a22b8641e7 req-ffacf202-2a97-416c-a675-c231d3576a18 service nova] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Received event network-vif-deleted-778fc191-dbfd-4ee5-8a9f-4ca3c4679804 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:35 user nova-compute[74836]: INFO nova.compute.manager [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 03:49:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:35 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:49:35 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:49:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:35 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Deleted allocations for instance cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d
Nov 14 03:49:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7ef47c40-ea1c-4c0a-bc36-7084b757217d tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "cea95ae4-b0d6-4eff-9a3d-b7a1539d3b0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.998s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:49:36 user nova-compute[74836]: INFO nova.compute.claims [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Claim successful on node user
Nov 14 03:49:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:49:36 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.policy [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f79fac66bb40488276060d4b59602d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991142d39c743fa8ebf2064ae8b3995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:49:36 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Creating image(s)
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "/opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "/opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "/opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk 1073741824" returned: 0 in 0.046s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Successfully created port: 212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Cannot resize image /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Ensure instance console log exists: /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Successfully updated port: 212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquired lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-changed-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Refreshing instance network info cache due to event network-changed-212897fb-a16e-4f17-a864-2148e9ce091e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] Acquiring lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:49:37 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updating instance_info_cache with network_info: [{"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Releasing lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Instance network_info: |[{"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] Acquired lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.neutron [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Refreshing network info cache for port 212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Start _get_guest_xml network_info=[{"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:49:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:49:38 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031440019',display_name='tempest-VolumesSnapshotTestJSON-instance-2031440019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031440019',id=42,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN57/9veAYsDgdrJ7W9Gb/3+275Cfkevjed+VfDnGN8elCn0BCMEaejyRZ+yzNcCAUOPgMpgY4qb4SZ/aD+z1Z/gMytgojJoyoRPyHKCs8qjekSuMEtGp8lNHqJHNjiRng==',key_name='tempest-keypair-1379209012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-oprftg22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=14024a7a-a903-4d08-9f66-ed122ced6969,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.objects.instance [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'pci_devices' on Instance uuid 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:49:38 user nova-compute[74836]:   <uuid>14024a7a-a903-4d08-9f66-ed122ced6969</uuid>
Nov 14 03:49:38 user nova-compute[74836]:   <name>instance-0000002a</name>
Nov 14 03:49:38 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:49:38 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:49:38 user nova-compute[74836]:   <metadata>
Nov 14 03:49:38 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:49:38 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2031440019</nova:name>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:49:38</nova:creationTime>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:49:38 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:49:38 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:owner>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:user uuid="b9f79fac66bb40488276060d4b59602d">tempest-VolumesSnapshotTestJSON-1646289946-project-member</nova:user>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:project uuid="6991142d39c743fa8ebf2064ae8b3995">tempest-VolumesSnapshotTestJSON-1646289946</nova:project>
Nov 14 03:49:38 user nova-compute[74836]:       </nova:owner>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:49:38 user nova-compute[74836]:       <nova:ports>
Nov 14 03:49:38 user nova-compute[74836]:         <nova:port uuid="212897fb-a16e-4f17-a864-2148e9ce091e">
Nov 14 03:49:38 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:49:38 user nova-compute[74836]:         </nova:port>
Nov 14 03:49:38 user nova-compute[74836]:       </nova:ports>
Nov 14 03:49:38 user nova-compute[74836]:     </nova:instance>
Nov 14 03:49:38 user nova-compute[74836]:   </metadata>
Nov 14 03:49:38 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:49:38 user nova-compute[74836]:     <system>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="serial">14024a7a-a903-4d08-9f66-ed122ced6969</entry>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="uuid">14024a7a-a903-4d08-9f66-ed122ced6969</entry>
Nov 14 03:49:38 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:49:38 user nova-compute[74836]:     </system>
Nov 14 03:49:38 user nova-compute[74836]:   </sysinfo>
Nov 14 03:49:38 user nova-compute[74836]:   <os>
Nov 14 03:49:38 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:49:38 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:49:38 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:49:38 user nova-compute[74836]:   </os>
Nov 14 03:49:38 user nova-compute[74836]:   <features>
Nov 14 03:49:38 user nova-compute[74836]:     <acpi/>
Nov 14 03:49:38 user nova-compute[74836]:     <apic/>
Nov 14 03:49:38 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:49:38 user nova-compute[74836]:   </features>
Nov 14 03:49:38 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:49:38 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:49:38 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:49:38 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:49:38 user nova-compute[74836]:   </clock>
Nov 14 03:49:38 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:49:38 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:49:38 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:49:38 user nova-compute[74836]:   </cpu>
Nov 14 03:49:38 user nova-compute[74836]:   <devices>
Nov 14 03:49:38 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:49:38 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:49:38 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk"/>
Nov 14 03:49:38 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:49:38 user nova-compute[74836]:     </disk>
Nov 14 03:49:38 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:49:38 user nova-compute[74836]:       <mac address="fa:16:3e:be:f8:e0"/>
Nov 14 03:49:38 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:49:38 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:49:38 user nova-compute[74836]:       <target dev="tap212897fb-a1"/>
Nov 14 03:49:38 user nova-compute[74836]:     </interface>
Nov 14 03:49:38 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:49:38 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/console.log" append="off"/>
Nov 14 03:49:38 user nova-compute[74836]:     </serial>
Nov 14 03:49:38 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:49:38 user nova-compute[74836]:     <video>
Nov 14 03:49:38 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:49:38 user nova-compute[74836]:     </video>
Nov 14 03:49:38 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:49:38 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:49:38 user nova-compute[74836]:     </rng>
Nov 14 03:49:38 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:49:38 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:49:38 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:49:38 user nova-compute[74836]:     </memballoon>
Nov 14 03:49:38 user nova-compute[74836]:   </devices>
Nov 14 03:49:38 user nova-compute[74836]: </domain>
Nov 14 03:49:38 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031440019',display_name='tempest-VolumesSnapshotTestJSON-instance-2031440019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031440019',id=42,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN57/9veAYsDgdrJ7W9Gb/3+275Cfkevjed+VfDnGN8elCn0BCMEaejyRZ+yzNcCAUOPgMpgY4qb4SZ/aD+z1Z/gMytgojJoyoRPyHKCs8qjekSuMEtGp8lNHqJHNjiRng==',key_name='tempest-keypair-1379209012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-oprftg22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=14024a7a-a903-4d08-9f66-ed122ced6969,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG os_vif [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03880a8e-110b-5e0d-b3fe-66f1a98a59b0', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap212897fb-a1, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap212897fb-a1, col_values=(('qos', UUID('4a47765a-b3e3-4422-a0f3-d2471dd8d0a2')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap212897fb-a1, col_values=(('external_ids', {'iface-id': '212897fb-a16e-4f17-a864-2148e9ce091e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:f8:e0', 'vm-uuid': '14024a7a-a903-4d08-9f66-ed122ced6969'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:38 user nova-compute[74836]: INFO os_vif [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1')
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No VIF found with MAC fa:16:3e:be:f8:e0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.neutron [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updated VIF entry in instance network info cache for port 212897fb-a16e-4f17-a864-2148e9ce091e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG nova.network.neutron [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updating instance_info_cache with network_info: [{"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:49:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a22755c4-c5bb-4b99-965c-f6a09d0b0535 req-26eb695e-4509-4a91-91b6-cb275cd18cab service nova] Releasing lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] No waiting events found dispatching network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:39 user nova-compute[74836]: WARNING nova.compute.manager [req-7b922e50-6161-442f-838a-42190ef09a7e req-60572e56-0ea7-47bf-869f-bcb2ae35ae3a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received unexpected event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e for instance with vm_state building and task_state spawning.
Nov 14 03:49:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:49:41 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Instance spawned successfully.
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:49:41 user nova-compute[74836]: INFO nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 03:49:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:49:41 user nova-compute[74836]: INFO nova.compute.manager [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Took 5.64 seconds to build instance.
Nov 14 03:49:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fc1aeb44-2222-4414-bf0a-58e7b638cff0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.868s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] No waiting events found dispatching network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:42 user nova-compute[74836]: WARNING nova.compute.manager [req-091cba2a-9f9d-465f-b12b-188add09df7f req-a3982959-8f69-4e9e-9d58-65c4f913ec4c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received unexpected event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e for instance with vm_state active and task_state None.
Nov 14 03:49:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:48 user nova-compute[74836]: INFO nova.compute.manager [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Terminating instance
Nov 14 03:49:48 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-unplugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] No waiting events found dispatching network-vif-unplugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-ff4d8ad2-e67c-4c0c-bb79-ac57916723c7 req-eba7883b-e889-4dc1-a067-acd1866162ea service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-unplugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Instance destroyed successfully.
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lazy-loading 'resources' on Instance uuid 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2118649159',display_name='tempest-ServerActionsTestOtherA-server-2118649159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2118649159',id=5,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfS4nJRCi+E6gIwOMM1B55OGhZg/QaAhx7JNuSGykdPgqThRmEjTeNN2I9V7+iTPDXLczHTcMDtTBCz9ImQX60vhBuV76P6TRGK3X+WagoluNTID910Vaia/Pn25M7TBA==',key_name='tempest-keypair-184198137',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06e7a009680c4c6d80ab5bb26d05b100',ramdisk_id='',reservation_id='r-g0yukk2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-585001335',owner_user_name='tempest-ServerActionsTestOtherA-585001335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:31:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9aff38e58fe4a1b8bd4d46ceda55ba3',uuid=96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converting VIF {"id": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "address": "fa:16:3e:ac:a7:32", "network": {"id": "4fd7d6fb-3b01-4f77-98dd-4635fd12d099", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1345875204-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06e7a009680c4c6d80ab5bb26d05b100", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa59ca6c0-1a", "ovs_interfaceid": "a59ca6c0-1a41-4d14-9de7-f56d96dcee3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG os_vif [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa59ca6c0-1a, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a26652fa-77db-4c36-9f7e-78b468c415c8) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:49:49 user nova-compute[74836]: INFO os_vif [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:a7:32,bridge_name='br-int',has_traffic_filtering=True,id=a59ca6c0-1a41-4d14-9de7-f56d96dcee3b,network=Network(4fd7d6fb-3b01-4f77-98dd-4635fd12d099),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa59ca6c0-1a')
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Deleting instance files /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571_del
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Deletion of /opt/stack/data/nova/instances/96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571_del complete
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.compute.manager [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 03:49:49 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Took 0.39 seconds to deallocate network for instance.
Nov 14 03:49:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:49:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:49 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Deleted allocations for instance 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571
Nov 14 03:49:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee6eb292-c2d4-40eb-a5f9-30ac3124334a tempest-ServerActionsTestOtherA-585001335 tempest-ServerActionsTestOtherA-585001335-project-member] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] Acquiring lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:49:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:49:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] Lock "96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:49:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] No waiting events found dispatching network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:49:50 user nova-compute[74836]: WARNING nova.compute.manager [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received unexpected event network-vif-plugged-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b for instance with vm_state deleted and task_state None.
Nov 14 03:49:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-018c67f9-0bc3-459d-b48c-166b7a1bc3b0 req-0684a352-c172-4309-af10-d4165e977cce service nova] [instance: 96ce2979-5ad3-4a0a-aaf1-5f5d2d0d2571] Received event network-vif-deleted-a59ca6c0-1a41-4d14-9de7-f56d96dcee3b {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:49:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:49:56 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:49:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:02 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:04 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8221MB free_disk=24.950828552246094GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 80245c74-184f-47a3-8b7f-37bea4240a7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance ab7919ca-8573-46f9-a7db-57c312b6c0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0009e5c8-f604-4057-9d64-d2c0297da6f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 14024a7a-a903-4d08-9f66-ed122ced6969 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:50:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:07 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-changed-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Refreshing instance network info cache due to event network-changed-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] Acquiring lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] Acquired lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Refreshing network info cache for port 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updated VIF entry in instance network info cache for port 4be07cc3-6ebf-429f-987f-af8dc5e0ce6d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG nova.network.neutron [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating instance_info_cache with network_info: [{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8d841d3b-2ab6-4cfb-b060-947c95592ea7 req-8f62ec08-c862-4836-9c1c-05488e5bd8dd service nova] Releasing lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:19 user nova-compute[74836]: INFO nova.compute.manager [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Attaching volume bdee47c1-424e-4d0a-8deb-47ec1df9650e to /dev/vdb
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.utils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829755c-a2e5-4901-8e61-3f625c5d93dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba802f67-9935-401f-bc38-96cca4bc46e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[87238fb8-035d-4004-a9ee-137cc173a64b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ebfa95-f89a-44a6-8436-fba3bd6c116b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:50:19 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:50:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80a400d-d191-4587-b564-1bbf608fd7ae]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG os_brick.utils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:50:19 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating existing volume attachment record: 7593ea2e-be8c-4077-b906-a7fa0b95af16 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:50:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:23 user nova-compute[74836]: INFO nova.compute.manager [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Terminating instance
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-unplugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] No waiting events found dispatching network-vif-unplugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-d8c187ef-1cd5-460b-b504-fb0cd72a463e req-934ea193-bc03-4209-9df0-b687d4ab7fa0 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-unplugged-fcae15f9-d363-4ad3-a487-ec483dea50ba for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFPNAUYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:50:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:50:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:50:23 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf428807-e655-49cb-88b1-b1157585f946]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:50:23 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba029af-c74c-4b17-ad7f-61609116c176]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e] added
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d19095-fbca-4a1e-8b33-2264999fa6b7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c5d6b1-7554-40aa-b18f-efdaac66a6a5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFPNAUYC {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KFPNAUYC" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf2c30-ebd9-4e95-beb6-266ae5d8ca83]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KFPNAUYC'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaea9ab-ced8-4b68-8cfb-b1aa324ab331]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efbd880-90e5-4c64-bc9b-27ba14b8c309]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[14262c72-80f3-409a-bb0a-2288d7bb8d80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260]
Nov 14 03:50:23 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260] successful.
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9b090-9cc7-45dd-a261-14ae7d3ccf79]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Instance destroyed successfully.
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lazy-loading 'resources' on Instance uuid c8eb5512-0d1f-4355-8ec9-c0cef174c2e0 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c0645e-8d27-4528-a7fc-bbc4ede6b372]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:23 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-686236951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-686236951',id=2,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:31:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9353de76529e464c82aa0d303b797362',ramdisk_id='',reservation_id='r-s3isv4w5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-273181148',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:32:42Z,user_data=None,user_id='7107bdffb0544dd890311071f04662ce',uuid=c8eb5512-0d1f-4355-8ec9-c0cef174c2e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converting VIF {"id": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "address": "fa:16:3e:40:27:3c", "network": {"id": "82f8d6cf-d543-4369-ac53-3242fee35e9d", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1108666650-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9353de76529e464c82aa0d303b797362", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcae15f9-d3", "ovs_interfaceid": "fcae15f9-d363-4ad3-a487-ec483dea50ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_vif [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcae15f9-d3, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7518e62-1d5a-4561-a811-04f61eddb622]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFPNAUYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4247a13-f21e-4954-8171-eeb68980b242) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:23 user nova-compute[74836]: INFO os_vif [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:27:3c,bridge_name='br-int',has_traffic_filtering=True,id=fcae15f9-d363-4ad3-a487-ec483dea50ba,network=Network(82f8d6cf-d543-4369-ac53-3242fee35e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcae15f9-d3')
Nov 14 03:50:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Deleting instance files /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0_del
Nov 14 03:50:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Deletion of /opt/stack/data/nova/instances/c8eb5512-0d1f-4355-8ec9-c0cef174c2e0_del complete
Nov 14 03:50:24 user nova-compute[74836]: INFO nova.compute.manager [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 03:50:24 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:24 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Took 0.45 seconds to deallocate network for instance.
Nov 14 03:50:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:24 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Deleted allocations for instance c8eb5512-0d1f-4355-8ec9-c0cef174c2e0
Nov 14 03:50:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a1c73da1-a1c5-4003-aac2-974f92b39fd7 tempest-ServerBootFromVolumeStableRescueTest-273181148 tempest-ServerBootFromVolumeStableRescueTest-273181148-project-member] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.787s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23530356337373335', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530356337373335', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:50:24 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:50:24 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:50:24 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:50:24 user nova-compute[74836]:   <serial>bdee47c1-424e-4d0a-8deb-47ec1df9650e</serial>
Nov 14 03:50:24 user nova-compute[74836]: </disk>
Nov 14 03:50:24 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] No VIF found with MAC fa:16:3e:e0:e4:fe, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] Acquiring lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] Lock "c8eb5512-0d1f-4355-8ec9-c0cef174c2e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] No waiting events found dispatching network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:25 user nova-compute[74836]: WARNING nova.compute.manager [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received unexpected event network-vif-plugged-fcae15f9-d363-4ad3-a487-ec483dea50ba for instance with vm_state deleted and task_state None.
Nov 14 03:50:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a9ff1d0-87b8-4a51-b299-c97817aeb8c3 req-7c759126-c1a7-4530-8c83-f9086a61b867 service nova] [instance: c8eb5512-0d1f-4355-8ec9-c0cef174c2e0] Received event network-vif-deleted-fcae15f9-d363-4ad3-a487-ec483dea50ba {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf41614-eb58-4a9c-9630-13e245812b21 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.307s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:25 user nova-compute[74836]: INFO nova.compute.manager [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Detaching volume bdee47c1-424e-4d0a-8deb-47ec1df9650e
Nov 14 03:50:25 user nova-compute[74836]: INFO nova.virt.block_device [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Attempting to driver detach volume bdee47c1-424e-4d0a-8deb-47ec1df9650e from mountpoint /dev/vdb
Nov 14 03:50:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Attempting to detach device vdb from instance ab7919ca-8573-46f9-a7db-57c312b6c0da from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:50:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:50:26 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:50:26 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:50:26 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:50:26 user nova-compute[74836]:   <serial>bdee47c1-424e-4d0a-8deb-47ec1df9650e</serial>
Nov 14 03:50:26 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:50:26 user nova-compute[74836]: </disk>
Nov 14 03:50:26 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:50:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance ab7919ca-8573-46f9-a7db-57c312b6c0da from the persistent domain config.
Nov 14 03:50:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab7919ca-8573-46f9-a7db-57c312b6c0da from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:50:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:50:26 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:50:26 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:50:26 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:50:26 user nova-compute[74836]:   <serial>bdee47c1-424e-4d0a-8deb-47ec1df9650e</serial>
Nov 14 03:50:26 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:50:26 user nova-compute[74836]: </disk>
Nov 14 03:50:26 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:50:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:50:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:32 user nova-compute[74836]: INFO nova.compute.manager [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Unshelving
Nov 14 03:50:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_requests' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'numa_topology' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:32 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:50:32 user nova-compute[74836]: INFO nova.compute.claims [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Claim successful on node user
Nov 14 03:50:33 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:33 user nova-compute[74836]: INFO nova.network.neutron [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating port 2c479662-53e5-41d4-bc51-5b25e4cd272d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG nova.network.neutron [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing instance network info cache due to event network-changed-2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] Acquiring lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:50:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Creating image(s)
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'trusted_certs' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] Acquired lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Refreshing network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG nova.objects.base [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<db4cbd53-aabe-4b4c-9fc2-65a593d301d4> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.part --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.part --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG nova.virt.images [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] f66cc5f6-1f11-4293-9c3a-6f0def53775c was qcow2, converting to raw {{(pid=74836) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG nova.privsep.utils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74836) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.part /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.converted {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updated VIF entry in instance network info cache for port 2c479662-53e5-41d4-bc51-5b25e4cd272d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG nova.network.neutron [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-17250fbb-ec41-4b43-a86d-7c5a34a01514 req-6d9aed6d-f68c-4925-8b1d-f8f35c9bc154 service nova] Releasing lock "refresh_cache-db4cbd53-aabe-4b4c-9fc2-65a593d301d4" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.part /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.converted" returned: 0 in 0.557s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.converted --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json" returned: 0 in 0.163s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9,backing_fmt=raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9,backing_fmt=raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk 1073741824" returned: 0 in 0.047s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "eb91755240c8e4634aa99705c8dc3b20dd6ac0f9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'migration_context' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:36 user nova-compute[74836]: DEBUG nova.objects.base [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<db4cbd53-aabe-4b4c-9fc2-65a593d301d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:50:36 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Rebasing disk image.
Nov 14 03:50:36 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:37 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 -F raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 -F raw /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk" returned: 0 in 2.391s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Ensure instance console log exists: /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start _get_guest_xml network_info=[{"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5d67e0ce5a29517b98779538f52abee5',container_format='bare',created_at=2023-11-14T03:48:40Z,direct_url=<?>,disk_format='qcow2',id=f66cc5f6-1f11-4293-9c3a-6f0def53775c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1592147205-shelved',owner='42a8a057308442f981535f38628faa53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T03:48:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:50:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5d67e0ce5a29517b98779538f52abee5',container_format='bare',created_at=2023-11-14T03:48:40Z,direct_url=<?>,disk_format='qcow2',id=f66cc5f6-1f11-4293-9c3a-6f0def53775c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1592147205-shelved',owner='42a8a057308442f981535f38628faa53',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T03:48:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'vcpu_model' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<db4cbd53-aabe-4b4c-9fc2-65a593d301d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='f66cc5f6-1f11-4293-9c3a-6f0def53775c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1425264219',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:48:44.702286',shelved_host='user',shelved_image_id='f66cc5f6-1f11-4293-9c3a-6f0def53775c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'pci_devices' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Object Instance<db4cbd53-aabe-4b4c-9fc2-65a593d301d4> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:50:39 user nova-compute[74836]:   <uuid>db4cbd53-aabe-4b4c-9fc2-65a593d301d4</uuid>
Nov 14 03:50:39 user nova-compute[74836]:   <name>instance-00000027</name>
Nov 14 03:50:39 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:50:39 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:50:39 user nova-compute[74836]:   <metadata>
Nov 14 03:50:39 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:50:39 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1592147205</nova:name>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:50:39</nova:creationTime>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:50:39 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:50:39 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:owner>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:user uuid="77ede53dd4ff404fbf5575c29105308b">tempest-AttachVolumeShelveTestJSON-267361624-project-member</nova:user>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:project uuid="42a8a057308442f981535f38628faa53">tempest-AttachVolumeShelveTestJSON-267361624</nova:project>
Nov 14 03:50:39 user nova-compute[74836]:       </nova:owner>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:root type="image" uuid="f66cc5f6-1f11-4293-9c3a-6f0def53775c"/>
Nov 14 03:50:39 user nova-compute[74836]:       <nova:ports>
Nov 14 03:50:39 user nova-compute[74836]:         <nova:port uuid="2c479662-53e5-41d4-bc51-5b25e4cd272d">
Nov 14 03:50:39 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:50:39 user nova-compute[74836]:         </nova:port>
Nov 14 03:50:39 user nova-compute[74836]:       </nova:ports>
Nov 14 03:50:39 user nova-compute[74836]:     </nova:instance>
Nov 14 03:50:39 user nova-compute[74836]:   </metadata>
Nov 14 03:50:39 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:50:39 user nova-compute[74836]:     <system>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="serial">db4cbd53-aabe-4b4c-9fc2-65a593d301d4</entry>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="uuid">db4cbd53-aabe-4b4c-9fc2-65a593d301d4</entry>
Nov 14 03:50:39 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:50:39 user nova-compute[74836]:     </system>
Nov 14 03:50:39 user nova-compute[74836]:   </sysinfo>
Nov 14 03:50:39 user nova-compute[74836]:   <os>
Nov 14 03:50:39 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:50:39 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:50:39 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:50:39 user nova-compute[74836]:   </os>
Nov 14 03:50:39 user nova-compute[74836]:   <features>
Nov 14 03:50:39 user nova-compute[74836]:     <acpi/>
Nov 14 03:50:39 user nova-compute[74836]:     <apic/>
Nov 14 03:50:39 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:50:39 user nova-compute[74836]:   </features>
Nov 14 03:50:39 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:50:39 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:50:39 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:50:39 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:50:39 user nova-compute[74836]:   </clock>
Nov 14 03:50:39 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:50:39 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:50:39 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:50:39 user nova-compute[74836]:   </cpu>
Nov 14 03:50:39 user nova-compute[74836]:   <devices>
Nov 14 03:50:39 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:50:39 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:50:39 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk"/>
Nov 14 03:50:39 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:50:39 user nova-compute[74836]:     </disk>
Nov 14 03:50:39 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:50:39 user nova-compute[74836]:       <mac address="fa:16:3e:1c:9d:0d"/>
Nov 14 03:50:39 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:50:39 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:50:39 user nova-compute[74836]:       <target dev="tap2c479662-53"/>
Nov 14 03:50:39 user nova-compute[74836]:     </interface>
Nov 14 03:50:39 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:50:39 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/console.log" append="off"/>
Nov 14 03:50:39 user nova-compute[74836]:     </serial>
Nov 14 03:50:39 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:50:39 user nova-compute[74836]:     <video>
Nov 14 03:50:39 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:50:39 user nova-compute[74836]:     </video>
Nov 14 03:50:39 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:50:39 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:50:39 user nova-compute[74836]:     </rng>
Nov 14 03:50:39 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:50:39 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:50:39 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:50:39 user nova-compute[74836]:     </memballoon>
Nov 14 03:50:39 user nova-compute[74836]:   </devices>
Nov 14 03:50:39 user nova-compute[74836]: </domain>
Nov 14 03:50:39 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='f66cc5f6-1f11-4293-9c3a-6f0def53775c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1425264219',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:46:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member',shelved_at='2023-11-14T03:48:44.702286',shelved_host='user',shelved_image_id='f66cc5f6-1f11-4293-9c3a-6f0def53775c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:50:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG os_vif [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81b91d1b-b48d-513b-ad0f-a93e95fdcbd8', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c479662-53, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c479662-53, col_values=(('qos', UUID('63f669e5-1bdb-4ea1-a335-fb5ef157098e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c479662-53, col_values=(('external_ids', {'iface-id': '2c479662-53e5-41d4-bc51-5b25e4cd272d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:9d:0d', 'vm-uuid': 'db4cbd53-aabe-4b4c-9fc2-65a593d301d4'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:39 user nova-compute[74836]: INFO os_vif [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53')
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:50:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] No VIF found with MAC fa:16:3e:1c:9d:0d, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:50:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing instance network info cache due to event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:41 user nova-compute[74836]: WARNING nova.compute.manager [req-7e33d9e1-8a68-4459-b966-a43ee02b2cf9 req-dd7db805-c6f3-40d4-9f19-ddcc8dfb3e8c service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updated VIF entry in instance network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2321e276-83fe-4795-8480-78c04866e558 req-de4f0d1c-da49-4d2a-b264-0c4bb4dbf7ac service nova] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:41 user nova-compute[74836]: INFO nova.compute.manager [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Shelve offloading
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:42 user nova-compute[74836]: WARNING nova.compute.manager [req-7f2d2f08-56a7-44aa-a9d2-1b446da77c14 req-0ed6aa1a-ca52-464d-a5cb-57a37501be1c service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state active and task_state shelving.
Nov 14 03:50:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance destroyed successfully.
Nov 14 03:50:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:50:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance spawned successfully.
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:43 user nova-compute[74836]: WARNING nova.compute.manager [req-13b69e19-52b9-4d5c-b924-289e6279bb2c req-d2307e7a-3ce9-40c0-b1c5-965418404b47 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-186e30f2-93b1-4526-8455-bb0c3069c5a1 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.709s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance destroyed successfully.
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.objects.instance [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'resources' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGB9kXXZI7btlYKz8qbwCl5qSXx9ePbigaOlVqmnu3Yul5a2sIXzX3Dv0gw8CgASpq/3OhHy3FGVm1xv2CUZ2zpOM8sMMCUsBy/v1w/eT9080f+Qu1oE7h+PZIPBd+H8w==',key_name='tempest-TestShelveInstance-259864335',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:49:00Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_vif [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8abca67-51, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fd434a8-4d20-4872-9ecc-4fbda91d4466) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:43 user nova-compute[74836]: INFO os_vif [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51')
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:50:43 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing instance network info cache due to event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.network.neutron [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a893465f-0006-4e34-900f-85f65ae5797b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:50:43 user nova-compute[74836]: No targets found.
Nov 14 03:50:43 user nova-compute[74836]: iSNS:
Nov 14 03:50:43 user nova-compute[74836]: No targets found.
Nov 14 03:50:43 user nova-compute[74836]: STATIC:
Nov 14 03:50:43 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61
Nov 14 03:50:43 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:43 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:43 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:50:43 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:43 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:43 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e
Nov 14 03:50:43 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:43 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:43 user nova-compute[74836]: FIRMWARE:
Nov 14 03:50:43 user nova-compute[74836]: No targets found.
Nov 14 03:50:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:50:43 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:50:43 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e4ba82-abb5-491e-af0d-eb1d3dc50459]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[29327e6c-c4c6-4313-a7c4-42a06ad74b34]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:43 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:43 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:43 user nova-compute[74836]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:50:43 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d414c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f38b39-be4f-412f-bd4b-3b10cc3c93b0]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87dcbf1-8a7e-44e8-af3d-ee75d8ca4aab]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64232c-3bfe-4051-95a3-92285fb18cdb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c372aee-2659-43b5-b740-b3ace6cbe379]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cdb98b-a79a-4c38-95e0-f7a4c53f83e9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b2f8ee-5d1a-4b6b-ab56-0661039580ee]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]
Nov 14 03:50:43 user nova-compute[74836]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.
Nov 14 03:50:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f612780a-044c-4155-9c6a-b1ebb99ad10e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== disconnect_volume: return (319ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:50:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:50:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deleting instance files /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3_del
Nov 14 03:50:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deletion of /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3_del complete
Nov 14 03:50:44 user nova-compute[74836]: DEBUG nova.network.neutron [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updated VIF entry in instance network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG nova.network.neutron [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": null, "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc8abca67-51", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bfd0014e-10d7-4a6f-9e49-a1e99381ca08 req-a5559ea7-f21f-472b-85d0-a7b7ebfa8930 service nova] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:44 user nova-compute[74836]: WARNING nova.compute.manager [req-f4085320-18bc-4b8a-9305-de4ed7c1efd3 req-a02acf8a-95bb-45b5-b456-d97b029ed760 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state active and task_state shelving.
Nov 14 03:50:44 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Deleted allocations for instance 0009e5c8-f604-4057-9d64-d2c0297da6f3
Nov 14 03:50:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'numa_topology' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG nova.objects.base [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Object Instance<0009e5c8-f604-4057-9d64-d2c0297da6f3> lazy-loaded attributes: resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34b17e04-9b1e-4b21-be24-298aa5800825 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.658s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:46 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab7919ca-8573-46f9-a7db-57c312b6c0da is timed out.
Nov 14 03:50:46 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully detached device vdb from instance ab7919ca-8573-46f9-a7db-57c312b6c0da from the live domain config.
Nov 14 03:50:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KFPNAUYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:50:46 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f14539-d94d-498f-87d9-32f066b4bdc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:50:46 user nova-compute[74836]: No targets found.
Nov 14 03:50:46 user nova-compute[74836]: iSNS:
Nov 14 03:50:46 user nova-compute[74836]: No targets found.
Nov 14 03:50:46 user nova-compute[74836]: STATIC:
Nov 14 03:50:46 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:50:46 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:46 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:46 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e
Nov 14 03:50:46 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:46 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:46 user nova-compute[74836]: FIRMWARE:
Nov 14 03:50:46 user nova-compute[74836]: No targets found.
Nov 14 03:50:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:50:46 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:50:46 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9791d0-7b30-4623-8017-0d279cd6f27e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ab815e-13b9-4b02-9935-1d05edb51a31]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:46 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:46 user nova-compute[74836]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e (non-flash)
Nov 14 03:50:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d42c9d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c963fa-c554-411b-a7ac-c6f5314c081c]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30ee5e-b049-4822-b314-6bdc1de7c8c5]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[795f786b-36f2-44ea-b5dc-8c9fcdd724b1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dba7722-6449-47e6-b6e0-5f7c94245cf8]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[86017d9e-18f8-4607-9bf3-6ba9586f45f0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[96886edb-784e-4a61-b8b2-35b5d46036c4]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260]
Nov 14 03:50:46 user nova-compute[74836]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e, portal: 172.16.0.220,3260] successful.
Nov 14 03:50:46 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdee47c1-424e-4d0a-8deb-47ec1df9650e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a132c-e269-4b40-8f7f-0a2cbdbc5903]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] <== disconnect_volume: return (306ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:50:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:50:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'flavor' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4ca973d9-4406-4620-b16e-c9d8af766104 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:49 user nova-compute[74836]: INFO nova.compute.manager [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Terminating instance
Nov 14 03:50:49 user nova-compute[74836]: DEBUG nova.compute.manager [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Instance destroyed successfully.
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.objects.instance [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lazy-loading 'resources' on Instance uuid 80245c74-184f-47a3-8b7f-37bea4240a7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:42:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2077651375',display_name='tempest-ServerActionsTestOtherB-server-2077651375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2077651375',id=33,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEa/4hhRwZ3aAHIaHfLt/CGbWs6j6AfPqKYbDmyX4x8BC0R/MdsLmpuDD1C9IvYvI17nvnjER054hCvxm44/CK13/+0o0UOcDxFN52IjlM1RCaZr4Q2U/AW5Z0nLU7kruQ==',key_name='tempest-keypair-474493944',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e55bd47c746b472496433ecbbc6115c3',ramdisk_id='',reservation_id='r-r58p6txw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1529116963',owner_user_name='tempest-ServerActionsTestOtherB-1529116963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b1b556cd49347c0bca921f02527a3bf',uuid=80245c74-184f-47a3-8b7f-37bea4240a7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converting VIF {"id": "b549e8cc-909f-4450-9b90-afd13379e321", "address": "fa:16:3e:dd:69:0b", "network": {"id": "152db0e3-e2b9-45a8-b968-8ef867aec4e6", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1341186127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e55bd47c746b472496433ecbbc6115c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb549e8cc-90", "ovs_interfaceid": "b549e8cc-909f-4450-9b90-afd13379e321", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_vif [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb549e8cc-90, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a5aa4ee-c427-472c-8c8c-60260f749188) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:50 user nova-compute[74836]: INFO os_vif [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:69:0b,bridge_name='br-int',has_traffic_filtering=True,id=b549e8cc-909f-4450-9b90-afd13379e321,network=Network(152db0e3-e2b9-45a8-b968-8ef867aec4e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb549e8cc-90')
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AHcVMSoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:50:50 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f0300-bac7-47fd-85d2-ebd2999764b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:50:50 user nova-compute[74836]: No targets found.
Nov 14 03:50:50 user nova-compute[74836]: iSNS:
Nov 14 03:50:50 user nova-compute[74836]: No targets found.
Nov 14 03:50:50 user nova-compute[74836]: STATIC:
Nov 14 03:50:50 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227
Nov 14 03:50:50 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:50:50 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:50:50 user nova-compute[74836]: FIRMWARE:
Nov 14 03:50:50 user nova-compute[74836]: No targets found.
Nov 14 03:50:50 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:50:50 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:50:50 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966ab05-81d6-4940-8dc2-090512637d22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d430669-0fe0-46e6-80df-a33bc4e692be]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:50 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 (non-flash)
Nov 14 03:50:50 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d414ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1d9a5f-7814-48ba-af12-1b2cab80737c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[096a3df8-d185-4399-8919-4f9a7e7f9de9]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6d69a-90db-49f1-9dc2-bf0f720a562e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bce670c-6865-46e0-a186-074b8baa8fb1]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[958935fc-cafa-4cca-a444-c14a795ead60]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[21488947-e65c-4b74-8b0e-93fb616292de]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260]
Nov 14 03:50:50 user nova-compute[74836]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227, portal: 172.16.0.220,3260] successful.
Nov 14 03:50:50 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b6b8b23-4c1c-4b88-b9ac-d708d9e48227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0c72e2-2720-4ed9-99ae-70f60fd002ec]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] <== disconnect_volume: return (320ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:50:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Deleting instance files /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_del
Nov 14 03:50:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Deletion of /opt/stack/data/nova/instances/80245c74-184f-47a3-8b7f-37bea4240a7a_del complete
Nov 14 03:50:50 user nova-compute[74836]: INFO nova.compute.manager [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 03:50:50 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:50:50 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:51 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Took 0.72 seconds to deallocate network for instance.
Nov 14 03:50:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-a3bd8b94-06d8-4e93-a3c6-9301222ed60b req-52d892a3-567e-4b18-b25d-7a236e1d7c3e service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Received event network-vif-deleted-b549e8cc-909f-4450-9b90-afd13379e321 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:51 user nova-compute[74836]: INFO nova.compute.manager [req-a3bd8b94-06d8-4e93-a3c6-9301222ed60b req-52d892a3-567e-4b18-b25d-7a236e1d7c3e service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Neutron deleted interface b549e8cc-909f-4450-9b90-afd13379e321; detaching it from the instance and deleting it from the info cache
Nov 14 03:50:51 user nova-compute[74836]: DEBUG nova.network.neutron [req-a3bd8b94-06d8-4e93-a3c6-9301222ed60b req-52d892a3-567e-4b18-b25d-7a236e1d7c3e service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-a3bd8b94-06d8-4e93-a3c6-9301222ed60b req-52d892a3-567e-4b18-b25d-7a236e1d7c3e service nova] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Detach interface failed, port_id=b549e8cc-909f-4450-9b90-afd13379e321, reason: Instance 80245c74-184f-47a3-8b7f-37bea4240a7a could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:50:51 user nova-compute[74836]: INFO nova.compute.manager [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] [instance: 80245c74-184f-47a3-8b7f-37bea4240a7a] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 03:50:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:50:52 user nova-compute[74836]: INFO nova.compute.claims [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Claim successful on node user
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.352s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:50:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:50:52 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Creating image(s)
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:52 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Deleted allocations for instance 80245c74-184f-47a3-8b7f-37bea4240a7a
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-4d25d995-40c9-4169-b383-04dd9bb69313 tempest-ServerActionsTestOtherB-1529116963 tempest-ServerActionsTestOtherB-1529116963-project-member] Lock "80245c74-184f-47a3-8b7f-37bea4240a7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.475s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG nova.policy [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '595bbdae7413457ebca1ac2c4c52fe50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d6ef35b32a4bfdb1763821cd7776c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:52 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk 1073741824" returned: 0 in 0.053s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Cannot resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Ensure instance console log exists: /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:53 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Successfully created port: fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Successfully updated port: fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-changed-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Refreshing instance network info cache due to event network-changed-fa572516-26b8-4528-9f55-3d0bdde667df. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance network_info: |[{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Refreshing network info cache for port fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start _get_guest_xml network_info=[{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:50:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:54 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'pci_devices' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:50:54 user nova-compute[74836]:   <uuid>cda3cfa8-f4db-4ac7-9d14-c9e90740a710</uuid>
Nov 14 03:50:54 user nova-compute[74836]:   <name>instance-0000002b</name>
Nov 14 03:50:54 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:50:54 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:50:54 user nova-compute[74836]:   <metadata>
Nov 14 03:50:54 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:50:54 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeTestJSON-server-1806491697</nova:name>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:50:54</nova:creationTime>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:50:54 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:50:54 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:owner>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:user uuid="595bbdae7413457ebca1ac2c4c52fe50">tempest-AttachVolumeTestJSON-152008285-project-member</nova:user>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:project uuid="69d6ef35b32a4bfdb1763821cd7776c0">tempest-AttachVolumeTestJSON-152008285</nova:project>
Nov 14 03:50:54 user nova-compute[74836]:       </nova:owner>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:50:54 user nova-compute[74836]:       <nova:ports>
Nov 14 03:50:54 user nova-compute[74836]:         <nova:port uuid="fa572516-26b8-4528-9f55-3d0bdde667df">
Nov 14 03:50:54 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:50:54 user nova-compute[74836]:         </nova:port>
Nov 14 03:50:54 user nova-compute[74836]:       </nova:ports>
Nov 14 03:50:54 user nova-compute[74836]:     </nova:instance>
Nov 14 03:50:54 user nova-compute[74836]:   </metadata>
Nov 14 03:50:54 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:50:54 user nova-compute[74836]:     <system>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="serial">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="uuid">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:50:54 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:50:54 user nova-compute[74836]:     </system>
Nov 14 03:50:54 user nova-compute[74836]:   </sysinfo>
Nov 14 03:50:54 user nova-compute[74836]:   <os>
Nov 14 03:50:54 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:50:54 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:50:54 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:50:54 user nova-compute[74836]:   </os>
Nov 14 03:50:54 user nova-compute[74836]:   <features>
Nov 14 03:50:54 user nova-compute[74836]:     <acpi/>
Nov 14 03:50:54 user nova-compute[74836]:     <apic/>
Nov 14 03:50:54 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:50:54 user nova-compute[74836]:   </features>
Nov 14 03:50:54 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:50:54 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:50:54 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:50:54 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:50:54 user nova-compute[74836]:   </clock>
Nov 14 03:50:54 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:50:54 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:50:54 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:50:54 user nova-compute[74836]:   </cpu>
Nov 14 03:50:54 user nova-compute[74836]:   <devices>
Nov 14 03:50:54 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:50:54 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:50:54 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk"/>
Nov 14 03:50:54 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:50:54 user nova-compute[74836]:     </disk>
Nov 14 03:50:54 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:50:54 user nova-compute[74836]:       <mac address="fa:16:3e:26:3c:3e"/>
Nov 14 03:50:54 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:50:54 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:50:54 user nova-compute[74836]:       <target dev="tapfa572516-26"/>
Nov 14 03:50:54 user nova-compute[74836]:     </interface>
Nov 14 03:50:54 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:50:54 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/console.log" append="off"/>
Nov 14 03:50:54 user nova-compute[74836]:     </serial>
Nov 14 03:50:54 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:50:54 user nova-compute[74836]:     <video>
Nov 14 03:50:54 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:50:54 user nova-compute[74836]:     </video>
Nov 14 03:50:54 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:50:54 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:50:54 user nova-compute[74836]:     </rng>
Nov 14 03:50:54 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:50:54 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:50:54 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:50:54 user nova-compute[74836]:     </memballoon>
Nov 14 03:50:54 user nova-compute[74836]:   </devices>
Nov 14 03:50:54 user nova-compute[74836]: </domain>
Nov 14 03:50:54 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG os_vif [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8f0a0a7-2063-586c-b3cf-0433758b6432', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa572516-26, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa572516-26, col_values=(('qos', UUID('8dbe7700-136c-4119-95cb-cea353280a19')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa572516-26, col_values=(('external_ids', {'iface-id': 'fa572516-26b8-4528-9f55-3d0bdde667df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3c:3e', 'vm-uuid': 'cda3cfa8-f4db-4ac7-9d14-c9e90740a710'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:54 user nova-compute[74836]: INFO os_vif [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No VIF found with MAC fa:16:3e:26:3c:3e, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated VIF entry in instance network info cache for port fa572516-26b8-4528-9f55-3d0bdde667df. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:50:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0d51d53f-19dc-4ce8-8814-14060c884bac req-6cc62300-71f8-40c5-9924-6f3c68c1d599 service nova] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:50:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG nova.compute.manager [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:56 user nova-compute[74836]: WARNING nova.compute.manager [req-dd28f02a-b0d5-4cfd-be9f-1813f9dd0550 req-8c02dc53-cf8a-4f96-b5fd-1c8eee1b7df1 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state building and task_state spawning.
Nov 14 03:50:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:50:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance spawned successfully.
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:50:58 user nova-compute[74836]: INFO nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:50:58 user nova-compute[74836]: INFO nova.compute.manager [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Took 6.24 seconds to build instance.
Nov 14 03:50:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ed503835-db5d-411f-9c12-d34029bdd108 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.338s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:50:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:50:58 user nova-compute[74836]: WARNING nova.compute.manager [req-fb39a2f0-27b1-4108-b30b-bdb006a15d3d req-50a7e6a3-ef32-40dc-ade0-2dbce8f30304 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state active and task_state None.
Nov 14 03:50:58 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:50:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:50:59 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:51:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating instance_info_cache with network_info: [{"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-ab7919ca-8573-46f9-a7db-57c312b6c0da" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:04 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:51:06 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:51:06 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8307MB free_disk=25.06570053100586GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance ab7919ca-8573-46f9-a7db-57c312b6c0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 14024a7a-a903-4d08-9f66-ed122ced6969 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:51:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:51:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:16 user nova-compute[74836]: INFO nova.compute.manager [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Terminating instance
Nov 14 03:51:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-unplugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] No waiting events found dispatching network-vif-unplugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-d80d96dc-970f-4c59-a654-d4fbe465b9db req-fc39c039-a730-41f3-ac3f-80cde7013f3f service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-unplugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Instance destroyed successfully.
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.objects.instance [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lazy-loading 'resources' on Instance uuid ab7919ca-8573-46f9-a7db-57c312b6c0da {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:48:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-96512077',display_name='tempest-AttachVolumeNegativeTest-server-96512077',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-96512077',id=40,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoGKUO729QOjH0cfmPIGHslHmgnC2Bd8KkDOb0yRqee63zTw83r8ddfGPCNclJS1zE7Rc0LrK7eokPR1GDEZqjS7SeSN2QW3IHx0ntOdyuCt53gtEq70/5yAGp1s+psQg==',key_name='tempest-keypair-671280961',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6087e90cb4f047b089b12a1e35e125ed',ramdisk_id='',reservation_id='r-dsj5xuxn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1016966726',owner_user_name='tempest-AttachVolumeNegativeTest-1016966726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3983545cf6a4d46858c309b90436dcd',uuid=ab7919ca-8573-46f9-a7db-57c312b6c0da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converting VIF {"id": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "address": "fa:16:3e:e0:e4:fe", "network": {"id": "4ee5b152-4797-45fc-9e66-f0891db06b83", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-28608223-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6087e90cb4f047b089b12a1e35e125ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4be07cc3-6e", "ovs_interfaceid": "4be07cc3-6ebf-429f-987f-af8dc5e0ce6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG os_vif [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4be07cc3-6e, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12dac848-4395-4013-bdb6-45bfd4c78e02) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:17 user nova-compute[74836]: INFO os_vif [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e4:fe,bridge_name='br-int',has_traffic_filtering=True,id=4be07cc3-6ebf-429f-987f-af8dc5e0ce6d,network=Network(4ee5b152-4797-45fc-9e66-f0891db06b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4be07cc3-6e')
Nov 14 03:51:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Deleting instance files /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da_del
Nov 14 03:51:17 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Deletion of /opt/stack/data/nova/instances/ab7919ca-8573-46f9-a7db-57c312b6c0da_del complete
Nov 14 03:51:17 user nova-compute[74836]: INFO nova.compute.manager [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 03:51:17 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:51:17 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Took 0.63 seconds to deallocate network for instance.
Nov 14 03:51:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:51:17 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-6865abea-2da8-4e00-a2ea-ee580dcd4f0a req-aa98e92f-a806-457b-8c4f-3fc647479a44 service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-deleted-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:51:18 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Deleted allocations for instance ab7919ca-8573-46f9-a7db-57c312b6c0da
Nov 14 03:51:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-80c2f3f1-3003-4f6d-a44a-fe194de62925 tempest-AttachVolumeNegativeTest-1016966726 tempest-AttachVolumeNegativeTest-1016966726-project-member] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] Acquiring lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] Lock "ab7919ca-8573-46f9-a7db-57c312b6c0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:18 user nova-compute[74836]: DEBUG nova.compute.manager [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] No waiting events found dispatching network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:51:18 user nova-compute[74836]: WARNING nova.compute.manager [req-e46bbb68-4953-4563-b1e9-8729e7292728 req-688b37b8-4f22-41df-b763-baffe74bd4fd service nova] [instance: ab7919ca-8573-46f9-a7db-57c312b6c0da] Received unexpected event network-vif-plugged-4be07cc3-6ebf-429f-987f-af8dc5e0ce6d for instance with vm_state deleted and task_state None.
Nov 14 03:51:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-changed-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.compute.manager [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Refreshing instance network info cache due to event network-changed-212897fb-a16e-4f17-a864-2148e9ce091e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] Acquiring lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] Acquired lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Refreshing network info cache for port 212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.objects.instance [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:51:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Ignoring supplied device name: /dev/vdb
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updated VIF entry in instance network info cache for port 212897fb-a16e-4f17-a864-2148e9ce091e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updating instance_info_cache with network_info: [{"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1bac04de-88ac-4fd4-b143-e3a6cb9743ba req-cf0ddb2f-cbc6-4adf-9c69-3b815b7b0025 service nova] Releasing lock "refresh_cache-14024a7a-a903-4d08-9f66-ed122ced6969" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:27 user nova-compute[74836]: INFO nova.compute.manager [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Attaching volume 447728bb-4017-43b0-a86c-ca1638a7859f to /dev/vdb
Nov 14 03:51:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG os_brick.utils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f048105-c92a-4d94-b98d-56a59afc4b87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc35ddc7-59d6-4363-b905-b29d97da9774]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fe51ea-38bf-41a7-9275-db6ea70ca03f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7185987a-3911-40f9-aa27-98d16bb3239a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:51:28 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:51:28 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb6659-30a1-48ca-9501-6db6e08cc735]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG os_brick.utils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:51:28 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updating existing volume attachment record: 27f2d356-024a-4a6a-ac93-f4ba98a35d7b {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:51:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdDcgvGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:51:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:51:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:51:32 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbbeff6-4583-4eb6-afee-48ff4611d8ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:51:32 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[886c8cd5-6693-482a-8260-d7b14acaa45a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f] added
Nov 14 03:51:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[379ee5a4-22d5-4d6c-95a3-cd4644dc9eba]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bc9e1-1f88-460a-96cc-209488835ceb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdDcgvGF {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TdDcgvGF" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09fe7e-c47d-4ead-83ef-acec60709429]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TdDcgvGF'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33544e8-2603-42db-a937-a3535b2da8bb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[416bceae-c2d7-45bc-93b2-bbf35052a2f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:51:32 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:51:32 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:51:32 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 03:51:32 user nova-compute[74836]: 
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2835b0-9318-4724-81e8-c02efa7fbbcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260]
Nov 14 03:51:32 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260] successful.
Nov 14 03:51:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[99805213-ab29-4f84-8b54-0c126794762a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd973c48-9b72-45bc-b481-ec6e26a13a0e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)
Nov 14 03:51:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)
Nov 14 03:51:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30158975-9ab9-4287-b04f-d20d1939d028]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:51:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdDcgvGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23538336262313534', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538336262313534', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:51:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:51:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:51:34 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:51:34 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:51:34 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:51:34 user nova-compute[74836]:   <serial>447728bb-4017-43b0-a86c-ca1638a7859f</serial>
Nov 14 03:51:34 user nova-compute[74836]: </disk>
Nov 14 03:51:34 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:51:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:51:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:51:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No VIF found with MAC fa:16:3e:be:f8:e0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:51:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-20cd8f36-a7a8-4097-b9d4-00676d8b8c8d tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.719s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:51:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:51:42 user nova-compute[74836]: INFO nova.compute.manager [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Detaching volume 447728bb-4017-43b0-a86c-ca1638a7859f
Nov 14 03:51:42 user nova-compute[74836]: INFO nova.virt.block_device [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Attempting to driver detach volume 447728bb-4017-43b0-a86c-ca1638a7859f from mountpoint /dev/vdb
Nov 14 03:51:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Attempting to detach device vdb from instance 14024a7a-a903-4d08-9f66-ed122ced6969 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:51:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:51:42 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:51:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:51:42 user nova-compute[74836]:   <serial>447728bb-4017-43b0-a86c-ca1638a7859f</serial>
Nov 14 03:51:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:51:42 user nova-compute[74836]: </disk>
Nov 14 03:51:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:51:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully detached device vdb from instance 14024a7a-a903-4d08-9f66-ed122ced6969 from the persistent domain config.
Nov 14 03:51:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 14024a7a-a903-4d08-9f66-ed122ced6969 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:51:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:51:42 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:51:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:51:42 user nova-compute[74836]:   <serial>447728bb-4017-43b0-a86c-ca1638a7859f</serial>
Nov 14 03:51:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:51:42 user nova-compute[74836]: </disk>
Nov 14 03:51:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:51:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:51:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:51:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:51:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:51:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:02 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 14024a7a-a903-4d08-9f66-ed122ced6969 is timed out.
Nov 14 03:52:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully detached device vdb from instance 14024a7a-a903-4d08-9f66-ed122ced6969 from the live domain config.
Nov 14 03:52:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdDcgvGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b927f0-9742-4355-aac9-c531c14a3aca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:52:03 user nova-compute[74836]: No targets found.
Nov 14 03:52:03 user nova-compute[74836]: iSNS:
Nov 14 03:52:03 user nova-compute[74836]: No targets found.
Nov 14 03:52:03 user nova-compute[74836]: STATIC:
Nov 14 03:52:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f
Nov 14 03:52:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:52:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:52:03 user nova-compute[74836]: FIRMWARE:
Nov 14 03:52:03 user nova-compute[74836]: No targets found.
Nov 14 03:52:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:52:03 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:52:03 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe1fe44-3b7e-407b-a64e-49821cfeb2be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a83164-aba3-4aab-a315-06c7b9881f33]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)
Nov 14 03:52:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f (non-flash)
Nov 14 03:52:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d42ca7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff49d19-bb6f-4fab-9caa-210d141197d6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664593d-1b3d-48c8-accd-74c93323bc95]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ccdd8c-f368-4c52-b5c0-ac9f1902cde0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821a038-c4de-45e3-bbe5-aa106f327b9a]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[688cf5f5-0f0f-4c8b-8cb9-f73920e4a4cb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8f3e11-c616-4853-885c-8f61c1e69813]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260]
Nov 14 03:52:03 user nova-compute[74836]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f, portal: 172.16.0.220,3260] successful.
Nov 14 03:52:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231a6fa-edfc-462e-a9f2-a1e02dc2ae07]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== disconnect_volume: return (264ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Skipping network cache update for instance because it is being deleted. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9971}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1befb4a0-156d-4fb6-b7ac-b0d26d8628c2 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.591s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.450s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:04 user nova-compute[74836]: INFO nova.compute.manager [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Terminating instance
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-unplugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] No waiting events found dispatching network-vif-unplugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [req-6ffd220f-804f-4e9b-b0cf-b9c07596d4a0 req-34574ad8-2942-489a-af59-614bb98b859c service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-unplugged-212897fb-a16e-4f17-a864-2148e9ce091e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:52:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:05 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Instance destroyed successfully.
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.objects.instance [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'resources' on Instance uuid 14024a7a-a903-4d08-9f66-ed122ced6969 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:49:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2031440019',display_name='tempest-VolumesSnapshotTestJSON-instance-2031440019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2031440019',id=42,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN57/9veAYsDgdrJ7W9Gb/3+275Cfkevjed+VfDnGN8elCn0BCMEaejyRZ+yzNcCAUOPgMpgY4qb4SZ/aD+z1Z/gMytgojJoyoRPyHKCs8qjekSuMEtGp8lNHqJHNjiRng==',key_name='tempest-keypair-1379209012',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:49:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-oprftg22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:49:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=14024a7a-a903-4d08-9f66-ed122ced6969,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "212897fb-a16e-4f17-a864-2148e9ce091e", "address": "fa:16:3e:be:f8:e0", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap212897fb-a1", "ovs_interfaceid": "212897fb-a16e-4f17-a864-2148e9ce091e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_vif [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap212897fb-a1, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a47765a-b3e3-4422-a0f3-d2471dd8d0a2) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:05 user nova-compute[74836]: INFO os_vif [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:f8:e0,bridge_name='br-int',has_traffic_filtering=True,id=212897fb-a16e-4f17-a864-2148e9ce091e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap212897fb-a1')
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:447728bb-4017-43b0-a86c-ca1638a7859f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TdDcgvGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:05 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[56a14c98-214e-4202-b1cd-cbff435fa6fd]: Unexpected error while running command.
Nov 14 03:52:05 user nova-compute[74836]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 03:52:05 user nova-compute[74836]: Exit code: 21
Nov 14 03:52:05 user nova-compute[74836]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 03:52:05 user nova-compute[74836]: Stderr: '' {{(pid=86110) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Nov 14 03:52:05 user nova-compute[74836]: Traceback (most recent call last):
Nov 14 03:52:05 user nova-compute[74836]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Nov 14 03:52:05 user nova-compute[74836]:     ret = func(*f_args, **f_kwargs)
Nov 14 03:52:05 user nova-compute[74836]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Nov 14 03:52:05 user nova-compute[74836]:     return func(*args, **kwargs)
Nov 14 03:52:05 user nova-compute[74836]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Nov 14 03:52:05 user nova-compute[74836]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Nov 14 03:52:05 user nova-compute[74836]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Nov 14 03:52:05 user nova-compute[74836]:     return putils.execute(on_execute=on_execute,
Nov 14 03:52:05 user nova-compute[74836]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Nov 14 03:52:05 user nova-compute[74836]:     raise ProcessExecutionError(exit_code=_returncode,
Nov 14 03:52:05 user nova-compute[74836]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 03:52:05 user nova-compute[74836]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 03:52:05 user nova-compute[74836]: Exit code: 21
Nov 14 03:52:05 user nova-compute[74836]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 03:52:05 user nova-compute[74836]: Stderr: ''
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a14c98-214e-4202-b1cd-cbff435fa6fd]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 03:52:05 user nova-compute[74836]: Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 03:52:05 user nova-compute[74836]: Exit code: 21
Nov 14 03:52:05 user nova-compute[74836]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 03:52:05 user nova-compute[74836]: Stderr: ''
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Nov 14 03:52:05 user nova-compute[74836]: ERROR os_brick.initiator.connectors.iscsi 
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74836) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== disconnect_volume: return (68ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:52:05 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Deleting instance files /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969_del
Nov 14 03:52:05 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Deletion of /opt/stack/data/nova/instances/14024a7a-a903-4d08-9f66-ed122ced6969_del complete
Nov 14 03:52:05 user nova-compute[74836]: INFO nova.compute.manager [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:52:05 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:05 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Took 0.74 seconds to deallocate network for instance.
Nov 14 03:52:06 user nova-compute[74836]: WARNING nova.volume.cinder [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Attachment 27f2d356-024a-4a6a-ac93-f4ba98a35d7b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 27f2d356-024a-4a6a-ac93-f4ba98a35d7b. (HTTP 404) (Request-ID: req-6ed9be04-1a7b-4853-89c1-21fd19a73351)
Nov 14 03:52:06 user nova-compute[74836]: INFO nova.compute.manager [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.648s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] Acquiring lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] Lock "14024a7a-a903-4d08-9f66-ed122ced6969-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] No waiting events found dispatching network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:06 user nova-compute[74836]: WARNING nova.compute.manager [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received unexpected event network-vif-plugged-212897fb-a16e-4f17-a864-2148e9ce091e for instance with vm_state deleted and task_state None.
Nov 14 03:52:06 user nova-compute[74836]: DEBUG nova.compute.manager [req-3d494195-6532-4c32-9833-4e2f3181a73e req-6155530d-5d3c-4a4d-bcc1-fb572bef692a service nova] [instance: 14024a7a-a903-4d08-9f66-ed122ced6969] Received event network-vif-deleted-212897fb-a16e-4f17-a864-2148e9ce091e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:06 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Deleted allocations for instance 14024a7a-a903-4d08-9f66-ed122ced6969
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-39b26bdf-37f7-492b-955f-71b971259bfd tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "14024a7a-a903-4d08-9f66-ed122ced6969" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.688s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:07 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:07 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.088420867919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:52:07 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:52:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:52:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:52:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:52:19 user nova-compute[74836]: INFO nova.compute.claims [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Claim successful on node user
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.232s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:52:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.policy [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3024413bb214165a8c60023c32a0113', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '445604164c76424e9bf337b6d934d679', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:52:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Creating image(s)
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "/opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "/opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "/opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk 1073741824" returned: 0 in 0.054s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Successfully created port: 48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.211s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Cannot resize image /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Ensure instance console log exists: /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Successfully updated port: 48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquired lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-changed-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG nova.compute.manager [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Refreshing instance network info cache due to event network-changed-48454bd7-7b1d-4f4b-8b05-589df3b69767. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] Acquiring lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Releasing lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Instance network_info: |[{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] Acquired lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Refreshing network info cache for port 48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Start _get_guest_xml network_info=[{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:52:22 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:22 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6438070',id=44,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyrdgakdxwgQs5mGTRKzujtMvDcnYfpxilJmp2YJBSPrdgQ0tCJ+jm/1Mblk8yb1K4LopKjmmwwu1aoZIp48oQ4il9SrvG5yUIjvnqz4XEefVAx5yYDjpQlg/kARTGHJA==',key_name='tempest-keypair-119015600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='445604164c76424e9bf337b6d934d679',ramdisk_id='',reservation_id='r-a3y5jpns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3024413bb214165a8c60023c32a0113',uuid=71b45b07-79ae-4427-a577-da70e027b104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converting VIF {"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.objects.instance [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lazy-loading 'pci_devices' on Instance uuid 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:52:22 user nova-compute[74836]:   <uuid>71b45b07-79ae-4427-a577-da70e027b104</uuid>
Nov 14 03:52:22 user nova-compute[74836]:   <name>instance-0000002c</name>
Nov 14 03:52:22 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:52:22 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:52:22 user nova-compute[74836]:   <metadata>
Nov 14 03:52:22 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:52:22 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022</nova:name>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:52:22</nova:creationTime>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:52:22 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:52:22 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:owner>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:user uuid="c3024413bb214165a8c60023c32a0113">tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member</nova:user>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:project uuid="445604164c76424e9bf337b6d934d679">tempest-TestServerVolumeAttachScenarioOldVersion-795314792</nova:project>
Nov 14 03:52:22 user nova-compute[74836]:       </nova:owner>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:52:22 user nova-compute[74836]:       <nova:ports>
Nov 14 03:52:22 user nova-compute[74836]:         <nova:port uuid="48454bd7-7b1d-4f4b-8b05-589df3b69767">
Nov 14 03:52:22 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:52:22 user nova-compute[74836]:         </nova:port>
Nov 14 03:52:22 user nova-compute[74836]:       </nova:ports>
Nov 14 03:52:22 user nova-compute[74836]:     </nova:instance>
Nov 14 03:52:22 user nova-compute[74836]:   </metadata>
Nov 14 03:52:22 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:52:22 user nova-compute[74836]:     <system>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="serial">71b45b07-79ae-4427-a577-da70e027b104</entry>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="uuid">71b45b07-79ae-4427-a577-da70e027b104</entry>
Nov 14 03:52:22 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:52:22 user nova-compute[74836]:     </system>
Nov 14 03:52:22 user nova-compute[74836]:   </sysinfo>
Nov 14 03:52:22 user nova-compute[74836]:   <os>
Nov 14 03:52:22 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:52:22 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:52:22 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:52:22 user nova-compute[74836]:   </os>
Nov 14 03:52:22 user nova-compute[74836]:   <features>
Nov 14 03:52:22 user nova-compute[74836]:     <acpi/>
Nov 14 03:52:22 user nova-compute[74836]:     <apic/>
Nov 14 03:52:22 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:52:22 user nova-compute[74836]:   </features>
Nov 14 03:52:22 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:52:22 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:52:22 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:52:22 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:52:22 user nova-compute[74836]:   </clock>
Nov 14 03:52:22 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:52:22 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:52:22 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:52:22 user nova-compute[74836]:   </cpu>
Nov 14 03:52:22 user nova-compute[74836]:   <devices>
Nov 14 03:52:22 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:52:22 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:52:22 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk"/>
Nov 14 03:52:22 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:52:22 user nova-compute[74836]:     </disk>
Nov 14 03:52:22 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:52:22 user nova-compute[74836]:       <mac address="fa:16:3e:c1:17:d0"/>
Nov 14 03:52:22 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:22 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:52:22 user nova-compute[74836]:       <target dev="tap48454bd7-7b"/>
Nov 14 03:52:22 user nova-compute[74836]:     </interface>
Nov 14 03:52:22 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:52:22 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/console.log" append="off"/>
Nov 14 03:52:22 user nova-compute[74836]:     </serial>
Nov 14 03:52:22 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:52:22 user nova-compute[74836]:     <video>
Nov 14 03:52:22 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:22 user nova-compute[74836]:     </video>
Nov 14 03:52:22 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:52:22 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:52:22 user nova-compute[74836]:     </rng>
Nov 14 03:52:22 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:52:22 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:52:22 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:52:22 user nova-compute[74836]:     </memballoon>
Nov 14 03:52:22 user nova-compute[74836]:   </devices>
Nov 14 03:52:22 user nova-compute[74836]: </domain>
Nov 14 03:52:22 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6438070',id=44,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyrdgakdxwgQs5mGTRKzujtMvDcnYfpxilJmp2YJBSPrdgQ0tCJ+jm/1Mblk8yb1K4LopKjmmwwu1aoZIp48oQ4il9SrvG5yUIjvnqz4XEefVAx5yYDjpQlg/kARTGHJA==',key_name='tempest-keypair-119015600',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='445604164c76424e9bf337b6d934d679',ramdisk_id='',reservation_id='r-a3y5jpns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3024413bb214165a8c60023c32a0113',uuid=71b45b07-79ae-4427-a577-da70e027b104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converting VIF {"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG os_vif [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab14ecf0-0d34-5975-bd95-fb7de61bc40c', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48454bd7-7b, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48454bd7-7b, col_values=(('qos', UUID('86c05c91-efcc-4f27-9cb5-c39ad6a9093e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48454bd7-7b, col_values=(('external_ids', {'iface-id': '48454bd7-7b1d-4f4b-8b05-589df3b69767', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:17:d0', 'vm-uuid': '71b45b07-79ae-4427-a577-da70e027b104'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:22 user nova-compute[74836]: INFO os_vif [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b')
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] No VIF found with MAC fa:16:3e:c1:17:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updated VIF entry in instance network info cache for port 48454bd7-7b1d-4f4b-8b05-589df3b69767. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.network.neutron [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8c4dca85-1f16-4346-990a-2c48c41b253e req-494335d4-f116-4a4c-9df5-91604c7fb1a8 service nova] Releasing lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:22 user nova-compute[74836]: INFO nova.compute.manager [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Terminating instance
Nov 14 03:52:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:52:22 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-cd1d5603-5d44-434f-bb60-c453fefca73f req-eac5e4db-29f2-4cca-9207-aeda7fd4bb4f service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-unplugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:52:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Instance destroyed successfully.
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lazy-loading 'resources' on Instance uuid db4cbd53-aabe-4b4c-9fc2-65a593d301d4 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:46:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1592147205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1592147205',id=39,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORHWbQGrZhoOBMY+RQqVARDHoLUtY5oX2mi+ndlT1uBJJVa9hR++fbH3dCDNps/REcq5GElrm8bO8FEOlBI3PraJA2TYTEos1cHpMTFMr1NBIdyti6zR8LtH0GOirqkYQ==',key_name='tempest-keypair-1425264219',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42a8a057308442f981535f38628faa53',ramdisk_id='',reservation_id='r-xnzk1rrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-267361624',owner_user_name='tempest-AttachVolumeShelveTestJSON-267361624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:50:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77ede53dd4ff404fbf5575c29105308b',uuid=db4cbd53-aabe-4b4c-9fc2-65a593d301d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converting VIF {"id": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "address": "fa:16:3e:1c:9d:0d", "network": {"id": "0b34291f-fbf2-4859-aa56-1848a58f6cf0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1984741148-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42a8a057308442f981535f38628faa53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c479662-53", "ovs_interfaceid": "2c479662-53e5-41d4-bc51-5b25e4cd272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG os_vif [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c479662-53, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63f669e5-1bdb-4ea1-a335-fb5ef157098e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: INFO os_vif [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:9d:0d,bridge_name='br-int',has_traffic_filtering=True,id=2c479662-53e5-41d4-bc51-5b25e4cd272d,network=Network(0b34291f-fbf2-4859-aa56-1848a58f6cf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c479662-53')
Nov 14 03:52:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Deleting instance files /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4_del
Nov 14 03:52:24 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Deletion of /opt/stack/data/nova/instances/db4cbd53-aabe-4b4c-9fc2-65a593d301d4_del complete
Nov 14 03:52:24 user nova-compute[74836]: INFO nova.compute.manager [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 03:52:24 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:24 user nova-compute[74836]: WARNING nova.compute.manager [req-148cad20-97de-4206-92f4-7cae0ee3e549 req-8080ca06-5c7e-4f22-9eaa-7a9d9c2b50f7 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state building and task_state spawning.
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:25 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Took 1.14 seconds to deallocate network for instance.
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] Acquiring lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG nova.compute.manager [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] No waiting events found dispatching network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:25 user nova-compute[74836]: WARNING nova.compute.manager [req-5bf13ad2-f0ea-4e06-8359-1cd5d27f6800 req-cd7b94c2-b3c9-474a-a130-792fbd80c051 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received unexpected event network-vif-plugged-2c479662-53e5-41d4-bc51-5b25e4cd272d for instance with vm_state deleted and task_state None.
Nov 14 03:52:25 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:25 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Deleted allocations for instance db4cbd53-aabe-4b4c-9fc2-65a593d301d4
Nov 14 03:52:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7348d7e2-cef8-4d12-b71b-b5d3afaed226 tempest-AttachVolumeShelveTestJSON-267361624 tempest-AttachVolumeShelveTestJSON-267361624-project-member] Lock "db4cbd53-aabe-4b4c-9fc2-65a593d301d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.711s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:52:26 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Instance spawned successfully.
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:26 user nova-compute[74836]: INFO nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:52:26 user nova-compute[74836]: INFO nova.compute.manager [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Took 6.78 seconds to build instance.
Nov 14 03:52:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-487b1a69-9385-44d2-8b8a-49f4c9e6d4f5 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.876s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:26 user nova-compute[74836]: WARNING nova.compute.manager [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state active and task_state None.
Nov 14 03:52:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-c6c3c992-798c-4eeb-9460-0482b83663da req-61b060c1-0799-424d-9ef8-18c9c45c4be8 service nova] [instance: db4cbd53-aabe-4b4c-9fc2-65a593d301d4] Received event network-vif-deleted-2c479662-53e5-41d4-bc51-5b25e4cd272d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:33 user nova-compute[74836]: INFO nova.compute.manager [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Unshelving
Nov 14 03:52:33 user nova-compute[74836]: INFO nova.virt.block_device [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Booting with volume fa98fcbd-e0ed-428b-957a-18296955bc61 at /dev/vda
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.utils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6df25d-b15b-409a-acf2-fe0dc6fb8ab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c48e3ba-7d42-45a8-a920-42ac14d96db3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5d6874-6a42-40cb-b0da-93422c28d9b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d078a77d-ef5f-445d-97cd-3f7f9de2b347]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:52:33 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:52:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbebcee0-f6cb-443c-8e25-9fdd34a4fa22]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG os_brick.utils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:33 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating existing volume attachment record: 8f11909f-a099-4f17-a236-bdfc6338da4a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:52:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG nova.objects.instance [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'pci_requests' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG nova.objects.instance [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'numa_topology' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:52:38 user nova-compute[74836]: INFO nova.compute.claims [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Claim successful on node user
Nov 14 03:52:38 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:38 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:38 user nova-compute[74836]: INFO nova.network.neutron [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing instance network info cache due to event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.network.neutron [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:52:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Creating image(s)
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Ensure instance console log exists: /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start _get_guest_xml network_info=[{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0009e5c8-f604-4057-9d64-d2c0297da6f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fa98fcbd-e0ed-428b-957a-18296955bc61', 'serial': 'fa98fcbd-e0ed-428b-957a-18296955bc61'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '8f11909f-a099-4f17-a236-bdfc6338da4a', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.network.neutron [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:52:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:39 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.objects.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Object Instance<0009e5c8-f604-4057-9d64-d2c0297da6f3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:39 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[437f6f29-1a6d-4f9f-bd47-1f1eb9c08b4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:52:40 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fe6620-4d32-496e-9abd-3e1bd5d953a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61] added
Nov 14 03:52:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[34886bc6-4cde-4d3d-9eb9-03923d8d6da7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[db084f9e-66a6-4a6e-aec4-44b56d3e8df6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMvnESTj {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qMvnESTj" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a1a233-068b-4867-bf80-f601f30d4b10]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qMvnESTj'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eea642-3ed3-4f1a-a551-a5937aab0fc6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[70616c07-0292-44b4-9dcc-a96da64af794]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:52:40 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 03:52:40 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:52:40 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 03:52:40 user nova-compute[74836]: 
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[360972aa-82ef-46fe-b747-e5ec53c99a48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]
Nov 14 03:52:40 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.
Nov 14 03:52:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa23c1-3aed-491f-8686-af9a22cf8fd0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1cf385-734a-4304-99c3-c039cc38390f]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c444962-a1d7-4c32-b4c4-c595bd9f2799]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG nova.network.neutron [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updated VIF entry in instance network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG nova.network.neutron [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b31035ae-b7d2-496d-8e96-7b0075be23e3 req-ac085d21-9ea5-42cf-af7d-caea6058ab65 service nova] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23334316239373131', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334316239373131', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-259864335',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:33Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.objects.instance [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'pci_devices' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.objects.base [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Object Instance<0009e5c8-f604-4057-9d64-d2c0297da6f3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:52:41 user nova-compute[74836]:   <uuid>0009e5c8-f604-4057-9d64-d2c0297da6f3</uuid>
Nov 14 03:52:41 user nova-compute[74836]:   <name>instance-00000029</name>
Nov 14 03:52:41 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:52:41 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:52:41 user nova-compute[74836]:   <metadata>
Nov 14 03:52:41 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:52:41 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:52:41 user nova-compute[74836]:       <nova:name>tempest-TestShelveInstance-server-470281484</nova:name>
Nov 14 03:52:41 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:52:39</nova:creationTime>
Nov 14 03:52:41 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:52:41 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:52:41 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:52:41 user nova-compute[74836]:       <nova:owner>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:user uuid="e7ec589b1f8c4a7b888e2a4c6b6be9de">tempest-TestShelveInstance-1788421859-project-member</nova:user>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:project uuid="2824a9ddbc86494d891293a862669345">tempest-TestShelveInstance-1788421859</nova:project>
Nov 14 03:52:41 user nova-compute[74836]:       </nova:owner>
Nov 14 03:52:41 user nova-compute[74836]:       <nova:ports>
Nov 14 03:52:41 user nova-compute[74836]:         <nova:port uuid="c8abca67-51cb-49ec-8ac7-2e1bd18c6792">
Nov 14 03:52:41 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:52:41 user nova-compute[74836]:         </nova:port>
Nov 14 03:52:41 user nova-compute[74836]:       </nova:ports>
Nov 14 03:52:41 user nova-compute[74836]:     </nova:instance>
Nov 14 03:52:41 user nova-compute[74836]:   </metadata>
Nov 14 03:52:41 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:52:41 user nova-compute[74836]:     <system>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="serial">0009e5c8-f604-4057-9d64-d2c0297da6f3</entry>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="uuid">0009e5c8-f604-4057-9d64-d2c0297da6f3</entry>
Nov 14 03:52:41 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:52:41 user nova-compute[74836]:     </system>
Nov 14 03:52:41 user nova-compute[74836]:   </sysinfo>
Nov 14 03:52:41 user nova-compute[74836]:   <os>
Nov 14 03:52:41 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:52:41 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:52:41 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:52:41 user nova-compute[74836]:   </os>
Nov 14 03:52:41 user nova-compute[74836]:   <features>
Nov 14 03:52:41 user nova-compute[74836]:     <acpi/>
Nov 14 03:52:41 user nova-compute[74836]:     <apic/>
Nov 14 03:52:41 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:52:41 user nova-compute[74836]:   </features>
Nov 14 03:52:41 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:52:41 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:52:41 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:52:41 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:52:41 user nova-compute[74836]:   </clock>
Nov 14 03:52:41 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:52:41 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:52:41 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:52:41 user nova-compute[74836]:   </cpu>
Nov 14 03:52:41 user nova-compute[74836]:   <devices>
Nov 14 03:52:41 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:52:41 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:52:41 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 03:52:41 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:52:41 user nova-compute[74836]:       <serial>fa98fcbd-e0ed-428b-957a-18296955bc61</serial>
Nov 14 03:52:41 user nova-compute[74836]:     </disk>
Nov 14 03:52:41 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:52:41 user nova-compute[74836]:       <mac address="fa:16:3e:54:35:d0"/>
Nov 14 03:52:41 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:41 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:52:41 user nova-compute[74836]:       <target dev="tapc8abca67-51"/>
Nov 14 03:52:41 user nova-compute[74836]:     </interface>
Nov 14 03:52:41 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:52:41 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3/console.log" append="off"/>
Nov 14 03:52:41 user nova-compute[74836]:     </serial>
Nov 14 03:52:41 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:52:41 user nova-compute[74836]:     <video>
Nov 14 03:52:41 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:41 user nova-compute[74836]:     </video>
Nov 14 03:52:41 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:52:41 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:52:41 user nova-compute[74836]:     </rng>
Nov 14 03:52:41 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:52:41 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:52:41 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:52:41 user nova-compute[74836]:     </memballoon>
Nov 14 03:52:41 user nova-compute[74836]:   </devices>
Nov 14 03:52:41 user nova-compute[74836]: </domain>
Nov 14 03:52:41 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-259864335',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:48:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:33Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG os_vif [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1662a88-30a8-5667-ac4b-08909494455a', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8abca67-51, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8abca67-51, col_values=(('qos', UUID('f5ef4e26-8c5e-4ec9-b2fe-6fedd36fca2c')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8abca67-51, col_values=(('external_ids', {'iface-id': 'c8abca67-51cb-49ec-8ac7-2e1bd18c6792', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:35:d0', 'vm-uuid': '0009e5c8-f604-4057-9d64-d2c0297da6f3'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:41 user nova-compute[74836]: INFO os_vif [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51')
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:52:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] No VIF found with MAC fa:16:3e:54:35:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:52:43 user nova-compute[74836]: INFO nova.compute.claims [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Claim successful on node user
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:43 user nova-compute[74836]: WARNING nova.compute.manager [req-1a791a62-c64d-41cc-93b8-8a981f4aa9d4 req-3d87e4fd-ae4b-4568-b168-8c144afd8d73 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-changed-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Refreshing instance network info cache due to event network-changed-fa572516-26b8-4528-9f55-3d0bdde667df. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.network.neutron [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Refreshing network info cache for port fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:52:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.policy [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b9f79fac66bb40488276060d4b59602d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6991142d39c743fa8ebf2064ae8b3995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:52:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Creating image(s)
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "/opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "/opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "/opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.network.neutron [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated VIF entry in instance network info cache for port fa572516-26b8-4528-9f55-3d0bdde667df. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG nova.network.neutron [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5084e189-22b6-4db2-bb47-8b8dd303e388 req-3871b5eb-b8e8-4f5f-a904-a93b7f110455 service nova] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.201s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk 1073741824" returned: 0 in 0.060s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.251s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Cannot resize image /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Ensure instance console log exists: /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Successfully created port: cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:45 user nova-compute[74836]: WARNING nova.compute.manager [req-43da59e7-7aad-4656-aedd-9e75ace95e32 req-109e8ebe-b212-468f-a0a7-61636d78cd33 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:52:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance spawned successfully.
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:45 user nova-compute[74836]: INFO nova.compute.manager [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Attaching volume c859770b-cb61-40c8-85b8-be1d25d837a8 to /dev/vdb
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Successfully updated port: cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquired lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.utils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-changed-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Refreshing instance network info cache due to event network-changed-cfbc085f-9b36-49f0-af9f-f0b81242ce2e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] Acquiring lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-79c16665-01ad-4510-b369-232c6f81578f tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.433s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[608bbbd2-51cd-4cdd-aac5-41096c180bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dad8a10-70c6-4963-a180-7c28c15e7dbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5abf4d-edc1-4864-b7c2-4645dcc50584]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bac0e3c-ceca-43fc-951b-4be9d09eaa8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:52:45 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1076727f-6f1f-43ca-a6b8-138082f0fc89]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG os_brick.utils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating existing volume attachment record: 853722ed-c781-4640-a1bf-4f0908bb01e2 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.network.neutron [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updating instance_info_cache with network_info: [{"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Releasing lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Instance network_info: |[{"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] Acquired lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.network.neutron [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Refreshing network info cache for port cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Start _get_guest_xml network_info=[{"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:52:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:52:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-146631268',display_name='tempest-VolumesSnapshotTestJSON-instance-146631268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-146631268',id=45,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk6GFE4lyOG+iv8h+h6rGp2b+/qlM/Co9B/BHEaEB6L+NG02lfJYedFjAklUI8HaHZwDaPiA3X2+r/0O3Ybjf2fxaLGFnuGu3vUsvhevbb+1kKU+mivc7TRyZmb6Oj3tw==',key_name='tempest-keypair-152086483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-cee5jwjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'pci_devices' on Instance uuid 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:52:46 user nova-compute[74836]:   <uuid>39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5</uuid>
Nov 14 03:52:46 user nova-compute[74836]:   <name>instance-0000002d</name>
Nov 14 03:52:46 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:52:46 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:52:46 user nova-compute[74836]:   <metadata>
Nov 14 03:52:46 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:52:46 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-146631268</nova:name>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:52:45</nova:creationTime>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:52:46 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:52:46 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:owner>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:user uuid="b9f79fac66bb40488276060d4b59602d">tempest-VolumesSnapshotTestJSON-1646289946-project-member</nova:user>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:project uuid="6991142d39c743fa8ebf2064ae8b3995">tempest-VolumesSnapshotTestJSON-1646289946</nova:project>
Nov 14 03:52:46 user nova-compute[74836]:       </nova:owner>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:52:46 user nova-compute[74836]:       <nova:ports>
Nov 14 03:52:46 user nova-compute[74836]:         <nova:port uuid="cfbc085f-9b36-49f0-af9f-f0b81242ce2e">
Nov 14 03:52:46 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 03:52:46 user nova-compute[74836]:         </nova:port>
Nov 14 03:52:46 user nova-compute[74836]:       </nova:ports>
Nov 14 03:52:46 user nova-compute[74836]:     </nova:instance>
Nov 14 03:52:46 user nova-compute[74836]:   </metadata>
Nov 14 03:52:46 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:52:46 user nova-compute[74836]:     <system>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="serial">39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5</entry>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="uuid">39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5</entry>
Nov 14 03:52:46 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:52:46 user nova-compute[74836]:     </system>
Nov 14 03:52:46 user nova-compute[74836]:   </sysinfo>
Nov 14 03:52:46 user nova-compute[74836]:   <os>
Nov 14 03:52:46 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:52:46 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:52:46 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:52:46 user nova-compute[74836]:   </os>
Nov 14 03:52:46 user nova-compute[74836]:   <features>
Nov 14 03:52:46 user nova-compute[74836]:     <acpi/>
Nov 14 03:52:46 user nova-compute[74836]:     <apic/>
Nov 14 03:52:46 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:52:46 user nova-compute[74836]:   </features>
Nov 14 03:52:46 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:52:46 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:52:46 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:52:46 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:52:46 user nova-compute[74836]:   </clock>
Nov 14 03:52:46 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:52:46 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:52:46 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:52:46 user nova-compute[74836]:   </cpu>
Nov 14 03:52:46 user nova-compute[74836]:   <devices>
Nov 14 03:52:46 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:52:46 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:52:46 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk"/>
Nov 14 03:52:46 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:52:46 user nova-compute[74836]:     </disk>
Nov 14 03:52:46 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:52:46 user nova-compute[74836]:       <mac address="fa:16:3e:70:fc:46"/>
Nov 14 03:52:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:46 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:52:46 user nova-compute[74836]:       <target dev="tapcfbc085f-9b"/>
Nov 14 03:52:46 user nova-compute[74836]:     </interface>
Nov 14 03:52:46 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:52:46 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/console.log" append="off"/>
Nov 14 03:52:46 user nova-compute[74836]:     </serial>
Nov 14 03:52:46 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:52:46 user nova-compute[74836]:     <video>
Nov 14 03:52:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:52:46 user nova-compute[74836]:     </video>
Nov 14 03:52:46 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:52:46 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:52:46 user nova-compute[74836]:     </rng>
Nov 14 03:52:46 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:52:46 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:52:46 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:52:46 user nova-compute[74836]:     </memballoon>
Nov 14 03:52:46 user nova-compute[74836]:   </devices>
Nov 14 03:52:46 user nova-compute[74836]: </domain>
Nov 14 03:52:46 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-146631268',display_name='tempest-VolumesSnapshotTestJSON-instance-146631268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-146631268',id=45,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk6GFE4lyOG+iv8h+h6rGp2b+/qlM/Co9B/BHEaEB6L+NG02lfJYedFjAklUI8HaHZwDaPiA3X2+r/0O3Ybjf2fxaLGFnuGu3vUsvhevbb+1kKU+mivc7TRyZmb6Oj3tw==',key_name='tempest-keypair-152086483',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-cee5jwjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG os_vif [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c209ae7-0a83-51ea-970f-32e68dd9f5b9', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcfbc085f-9b, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcfbc085f-9b, col_values=(('qos', UUID('e248d949-1abe-410e-b62d-e44704268dd1')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcfbc085f-9b, col_values=(('external_ids', {'iface-id': 'cfbc085f-9b36-49f0-af9f-f0b81242ce2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:fc:46', 'vm-uuid': '39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: INFO os_vif [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b')
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No VIF found with MAC fa:16:3e:70:fc:46, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updated VIF entry in instance network info cache for port cfbc085f-9b36-49f0-af9f-f0b81242ce2e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG nova.network.neutron [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updating instance_info_cache with network_info: [{"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:52:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-09ddd1d9-b696-43ad-b444-64d016acf7ac req-a2a686a5-14c0-4d09-b076-fb72373685d1 service nova] Releasing lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:52:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] No waiting events found dispatching network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:48 user nova-compute[74836]: WARNING nova.compute.manager [req-11091967-0b3a-4c2c-bb16-5c9627aded78 req-02115a15-ee3b-4e00-a7ac-17510e266950 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received unexpected event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e for instance with vm_state building and task_state spawning.
Nov 14 03:52:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:52:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Instance spawned successfully.
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] No waiting events found dispatching network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:50 user nova-compute[74836]: WARNING nova.compute.manager [req-65c5b2a3-404c-4710-9c5f-b47231e79f3d req-8753e9e1-7355-4444-9af3-be9040d78fc9 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received unexpected event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e for instance with vm_state building and task_state spawning.
Nov 14 03:52:50 user nova-compute[74836]: INFO nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:52:50 user nova-compute[74836]: INFO nova.compute.manager [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Took 7.72 seconds to build instance.
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-3a37b016-2825-4ad5-8839-7ed64b52a0c0 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.861s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:52:50 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:50 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:52:50 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1154bd-d90b-4330-a535-c358c7509597]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:52:50 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7af8ede-7286-46f9-ba4e-f4895164c27b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8] added
Nov 14 03:52:50 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a42d5ba-c0a0-4027-b9eb-3129d0e25127]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764ecfb-1606-45f5-96ee-c6f9c8cce6d9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyDFZMTm {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyDFZMTm" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3659a4-f6e1-4a82-8b51-3355eae642d2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyDFZMTm'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3556025-ae4a-4951-add2-eb8acc3050a1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1839bd-26a3-4e44-8df6-af0fcd33d0f9]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc3482d-8046-4716-af16-bb599fdd4e04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]
Nov 14 03:52:51 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.
Nov 14 03:52:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c97fc-e109-4659-b404-9e8f3cb0dc82]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2299fd53-1b5a-4a6c-83a5-81f077eb6bcd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:52:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec22ad3b-2e4b-40dc-ab08-0467c1b9930f]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:52:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23061386566616166', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061386566616166', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:52:52 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:52:52 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:52:52 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:52:52 user nova-compute[74836]:   <serial>c859770b-cb61-40c8-85b8-be1d25d837a8</serial>
Nov 14 03:52:52 user nova-compute[74836]: </disk>
Nov 14 03:52:52 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No VIF found with MAC fa:16:3e:26:3c:3e, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:52:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ee3dcab6-34b2-47fd-bce9-d8d7cb15e702 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.302s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74836) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:53 user nova-compute[74836]: WARNING nova.compute.manager [req-2d83e5e1-de97-4701-8175-b28978bd455b req-d353eafe-e0a0-4f50-9340-3adb55fa4107 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state active and task_state powering-off.
Nov 14 03:52:54 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance destroyed successfully.
Nov 14 03:52:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:52:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9fc3227e-83b7-4b34-8e46-d95aedb4baf7 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.080s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:52:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:52:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:52:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:52:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:52:55 user nova-compute[74836]: WARNING nova.compute.manager [req-b74b780d-97a2-4d2f-9c0b-a59d3995ee02 req-8c17eefc-096c-4665-a487-1bc0ce571fd4 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state stopped and task_state None.
Nov 14 03:52:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:52:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:00 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:53:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:05 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:53:05 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:06 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:53:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:53:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8434MB free_disk=25.0457763671875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 71b45b07-79ae-4427-a577-da70e027b104 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0009e5c8-f604-4057-9d64-d2c0297da6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:53:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:12 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:53:12 user nova-compute[74836]: INFO nova.compute.claims [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Claim successful on node user
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.288s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:53:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.policy [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:53:13 user nova-compute[74836]: INFO nova.virt.block_device [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Booting with volume snapshot a22abee6-8da6-46cf-908b-f9b129c179bf at /dev/vda
Nov 14 03:53:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Successfully created port: 5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Successfully updated port: 5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-changed-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Refreshing instance network info cache due to event network-changed-5ab226a4-bb0d-4aef-980f-e6600070b825. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] Acquiring lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.network.neutron [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updating instance_info_cache with network_info: [{"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Instance network_info: |[{"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] Acquired lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:53:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Refreshing network info cache for port 5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:53:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updated VIF entry in instance network info cache for port 5ab226a4-bb0d-4aef-980f-e6600070b825. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:53:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updating instance_info_cache with network_info: [{"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:53:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a0d67e44-2ed2-4153-9ac8-cc88b40390a0 req-62a6aabe-22c6-4ea9-ab33-a97aee4a826b service nova] Releasing lock "refresh_cache-5895f3d7-3754-401f-9b27-bab9481a543f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:53:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:53:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:18 user nova-compute[74836]: DEBUG os_brick.utils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:53:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a04754-65ca-4c95-90e3-744c04517aac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[037df88b-d005-40c3-b165-0a47a55a444b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c6cbfe-fe93-4da4-88be-9abc91297a02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a66e1ee-6977-47e7-89a4-6ea7a4cb3ac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:53:19 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:53:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31fc7e-6140-42eb-9d0f-5da36160a0be]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG os_brick.utils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:53:19 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updating existing volume attachment record: 2ae5738a-7817-44b6-986a-60f5b19c6df1 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:53:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:53:23 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Creating image(s)
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Ensure instance console log exists: /opt/stack/data/nova/instances/5895f3d7-3754-401f-9b27-bab9481a543f/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Start _get_guest_xml network_info=[{"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGaEbFeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5895f3d7-3754-401f-9b27-bab9481a543f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ca5597b9-37f2-4d71-9830-16c726702739', 'serial': 'ca5597b9-37f2-4d71-9830-16c726702739'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '2ae5738a-7817-44b6-986a-60f5b19c6df1', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:53:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:53:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGaEbFeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:53:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:53:23 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:53:23 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f57f49e-7059-4bff-ac67-8da2b82a93d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:53:23 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ebeabf-3794-4760-b224-919d0900a65d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739] added
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faafa46-2026-45e4-9e2a-ae2fff04c9e2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b5da21-c401-41b1-ab16-57e1bab291d3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGaEbFeI {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VGaEbFeI" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d41119-8ffc-4aa4-aed8-f5814940ba38]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VGaEbFeI'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3fdd7b-d56d-471e-b919-807ffa02f5c2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20f2bd-b31e-4612-b6ed-3fb307b9bb6b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85c9763-4b3b-4968-bb82-789047f1184a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260]
Nov 14 03:53:23 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260] successful.
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f089a-9b33-4f49-89d2-54570d4e63e3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[480db827-3393-4136-b274-e02cabf72beb]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:53:23 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cecad0-2606-43e4-b54b-ec847812f085]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:53:23 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGaEbFeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26136383332353862', 'path': '/dev/sdd'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136383332353862', 'path': '/dev/sdd'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476377613',display_name='tempest-TestVolumeBootPattern-server-476377613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476377613',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-wpex9ca8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:53:13Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=5895f3d7-3754-401f-9b27-bab9481a543f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.objects.instance [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid 5895f3d7-3754-401f-9b27-bab9481a543f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:53:24 user nova-compute[74836]:   <uuid>5895f3d7-3754-401f-9b27-bab9481a543f</uuid>
Nov 14 03:53:24 user nova-compute[74836]:   <name>instance-0000002e</name>
Nov 14 03:53:24 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:53:24 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:53:24 user nova-compute[74836]:   <metadata>
Nov 14 03:53:24 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:53:24 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:53:24 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-server-476377613</nova:name>
Nov 14 03:53:24 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:53:23</nova:creationTime>
Nov 14 03:53:24 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:53:24 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:53:24 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:53:24 user nova-compute[74836]:       <nova:owner>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 03:53:24 user nova-compute[74836]:       </nova:owner>
Nov 14 03:53:24 user nova-compute[74836]:       <nova:ports>
Nov 14 03:53:24 user nova-compute[74836]:         <nova:port uuid="5ab226a4-bb0d-4aef-980f-e6600070b825">
Nov 14 03:53:24 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 03:53:24 user nova-compute[74836]:         </nova:port>
Nov 14 03:53:24 user nova-compute[74836]:       </nova:ports>
Nov 14 03:53:24 user nova-compute[74836]:     </nova:instance>
Nov 14 03:53:24 user nova-compute[74836]:   </metadata>
Nov 14 03:53:24 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:53:24 user nova-compute[74836]:     <system>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="serial">5895f3d7-3754-401f-9b27-bab9481a543f</entry>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="uuid">5895f3d7-3754-401f-9b27-bab9481a543f</entry>
Nov 14 03:53:24 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:53:24 user nova-compute[74836]:     </system>
Nov 14 03:53:24 user nova-compute[74836]:   </sysinfo>
Nov 14 03:53:24 user nova-compute[74836]:   <os>
Nov 14 03:53:24 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:53:24 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:53:24 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:53:24 user nova-compute[74836]:   </os>
Nov 14 03:53:24 user nova-compute[74836]:   <features>
Nov 14 03:53:24 user nova-compute[74836]:     <acpi/>
Nov 14 03:53:24 user nova-compute[74836]:     <apic/>
Nov 14 03:53:24 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:53:24 user nova-compute[74836]:   </features>
Nov 14 03:53:24 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:53:24 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:53:24 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:53:24 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:53:24 user nova-compute[74836]:   </clock>
Nov 14 03:53:24 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:53:24 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:53:24 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:53:24 user nova-compute[74836]:   </cpu>
Nov 14 03:53:24 user nova-compute[74836]:   <devices>
Nov 14 03:53:24 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:53:24 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:53:24 user nova-compute[74836]:       <source dev="/dev/sdd"/>
Nov 14 03:53:24 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:53:24 user nova-compute[74836]:       <serial>ca5597b9-37f2-4d71-9830-16c726702739</serial>
Nov 14 03:53:24 user nova-compute[74836]:     </disk>
Nov 14 03:53:24 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:53:24 user nova-compute[74836]:       <mac address="fa:16:3e:73:91:0e"/>
Nov 14 03:53:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:53:24 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:53:24 user nova-compute[74836]:       <target dev="tap5ab226a4-bb"/>
Nov 14 03:53:24 user nova-compute[74836]:     </interface>
Nov 14 03:53:24 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:53:24 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/5895f3d7-3754-401f-9b27-bab9481a543f/console.log" append="off"/>
Nov 14 03:53:24 user nova-compute[74836]:     </serial>
Nov 14 03:53:24 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:53:24 user nova-compute[74836]:     <video>
Nov 14 03:53:24 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:53:24 user nova-compute[74836]:     </video>
Nov 14 03:53:24 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:53:24 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:53:24 user nova-compute[74836]:     </rng>
Nov 14 03:53:24 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:53:24 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:53:24 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:53:24 user nova-compute[74836]:     </memballoon>
Nov 14 03:53:24 user nova-compute[74836]:   </devices>
Nov 14 03:53:24 user nova-compute[74836]: </domain>
Nov 14 03:53:24 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476377613',display_name='tempest-TestVolumeBootPattern-server-476377613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476377613',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-wpex9ca8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:53:13Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=5895f3d7-3754-401f-9b27-bab9481a543f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG os_vif [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2bc3dbc-46fa-594f-a1d5-27a81039abc7', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ab226a4-bb, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ab226a4-bb, col_values=(('qos', UUID('2d3f0119-54ee-4173-b437-7e2174ead2ea')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ab226a4-bb, col_values=(('external_ids', {'iface-id': '5ab226a4-bb0d-4aef-980f-e6600070b825', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:91:0e', 'vm-uuid': '5895f3d7-3754-401f-9b27-bab9481a543f'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:24 user nova-compute[74836]: INFO os_vif [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb')
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:53:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:73:91:0e, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] No waiting events found dispatching network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:53:26 user nova-compute[74836]: WARNING nova.compute.manager [req-fbd669aa-0f7e-4bc6-bbb3-44a72fadd931 req-606ccb9c-3d15-4024-a592-5b9dabffd29b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received unexpected event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 for instance with vm_state building and task_state spawning.
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:53:28 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Instance spawned successfully.
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] No waiting events found dispatching network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:53:28 user nova-compute[74836]: WARNING nova.compute.manager [req-f3f2ba8a-aa87-4698-ab88-4e2b34d2748d req-dc9abae7-af61-4ad3-bb9e-bfd2f460fe24 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received unexpected event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 for instance with vm_state building and task_state spawning.
Nov 14 03:53:28 user nova-compute[74836]: INFO nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 03:53:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:53:28 user nova-compute[74836]: INFO nova.compute.manager [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Took 15.75 seconds to build instance.
Nov 14 03:53:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-43322aee-b890-4c6b-902c-6a19404d5f45 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.841s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:53:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:53:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:53:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:01 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:04 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:05 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:54:07 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:54:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:08 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-changed-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Refreshing instance network info cache due to event network-changed-48454bd7-7b1d-4f4b-8b05-589df3b69767. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] Acquiring lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] Acquired lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Refreshing network info cache for port 48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:54:10 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:54:10 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=25.024627685546875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 71b45b07-79ae-4427-a577-da70e027b104 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 0009e5c8-f604-4057-9d64-d2c0297da6f3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 5895f3d7-3754-401f-9b27-bab9481a543f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:54:10 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.369s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updated VIF entry in instance network info cache for port 48454bd7-7b1d-4f4b-8b05-589df3b69767. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG nova.network.neutron [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-89296b02-f98d-43a2-bd71-1a636b40f33e req-d84f2b1c-ef97-450b-a65e-013d734df65a service nova] Releasing lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:54:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG nova.objects.instance [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lazy-loading 'flavor' on Instance uuid 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:12 user nova-compute[74836]: INFO nova.compute.manager [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Attaching volume 7946c380-fddd-46c4-9577-7ed83afee770 to /dev/vdb
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.utils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5335c629-5e22-4800-828a-731022400087]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c010b68-da92-4679-8e72-075b06e9d10b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082f37d-b15c-42cb-b597-d70e764b2548]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cdc931-d7df-4d38-b965-c20b0d30282b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:54:12 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:54:12 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66cdd00-e4dd-4e2a-b32c-f339b0cefba4]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG os_brick.utils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:12 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating existing volume attachment record: a0c61116-bf0a-4506-8e16-c5a6e1321448 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:54:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIWMCicQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:17 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:17 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:17 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d910f03-39f1-483b-b90f-21fdf5ebf762]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:54:17 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb83cf3-0fbf-413d-a49b-894ac08f8e22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770] added
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[031b3a2c-fe27-4674-92d4-7e54bf6ff0c1]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dab5a0-9c3e-409f-860c-8de1d2733f47]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIWMCicQ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIWMCicQ" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86edcc6-186f-4fde-8ab2-294aaf2fe286]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIWMCicQ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3599904c-cc82-4825-90e4-36838f500462]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8401b7-071e-4250-af72-8c8065266471]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[214648e3-2c48-4ce3-afa0-168eb58a44b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260]
Nov 14 03:54:17 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d11165-9cdf-4fca-a449-0f7d75fe1876]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3e2dd2-271d-4311-b534-0ca6c7a1831c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:17 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb2fb2-9580-4537-9307-dda9703a81c0]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:54:17 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIWMCicQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26436663266383665', 'path': '/dev/sde'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436663266383665', 'path': '/dev/sde'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.objects.instance [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lazy-loading 'flavor' on Instance uuid 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:54:18 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:18 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:54:18 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:18 user nova-compute[74836]:   <serial>7946c380-fddd-46c4-9577-7ed83afee770</serial>
Nov 14 03:54:18 user nova-compute[74836]: </disk>
Nov 14 03:54:18 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] No VIF found with MAC fa:16:3e:c1:17:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:54:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-78a83e2c-5cf0-43d9-a7e5-90ed6c74fa4f tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.190s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:20 user nova-compute[74836]: INFO nova.compute.manager [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Detaching volume 7946c380-fddd-46c4-9577-7ed83afee770
Nov 14 03:54:20 user nova-compute[74836]: INFO nova.virt.block_device [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Attempting to driver detach volume 7946c380-fddd-46c4-9577-7ed83afee770 from mountpoint /dev/vdb
Nov 14 03:54:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Attempting to detach device vdb from instance 71b45b07-79ae-4427-a577-da70e027b104 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:54:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:54:20 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:20 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:54:20 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:20 user nova-compute[74836]:   <serial>7946c380-fddd-46c4-9577-7ed83afee770</serial>
Nov 14 03:54:20 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:54:20 user nova-compute[74836]: </disk>
Nov 14 03:54:20 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:54:20 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Successfully detached device vdb from instance 71b45b07-79ae-4427-a577-da70e027b104 from the persistent domain config.
Nov 14 03:54:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71b45b07-79ae-4427-a577-da70e027b104 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:54:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:54:20 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:20 user nova-compute[74836]:   <source dev="/dev/sde"/>
Nov 14 03:54:20 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:20 user nova-compute[74836]:   <serial>7946c380-fddd-46c4-9577-7ed83afee770</serial>
Nov 14 03:54:20 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:54:20 user nova-compute[74836]: </disk>
Nov 14 03:54:20 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:54:20 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:54:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing instance network info cache due to event network-changed-c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] Acquiring lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] Acquired lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Refreshing network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:24 user nova-compute[74836]: INFO nova.compute.manager [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Terminating instance
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updated VIF entry in instance network info cache for port c8abca67-51cb-49ec-8ac7-2e1bd18c6792. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [{"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-d55750c0-5e1f-4b65-8449-4c3151648a83 req-f840452b-e8c0-425a-933f-4951d5a03aee service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-unplugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:54:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7b0209a5-9f24-47f3-8471-e56efc82bd2a req-1a6f90b6-6dfd-41aa-b6bd-1a650a962933 service nova] Releasing lock "refresh_cache-0009e5c8-f604-4057-9d64-d2c0297da6f3" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:54:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Instance destroyed successfully.
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.objects.instance [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lazy-loading 'resources' on Instance uuid 0009e5c8-f604-4057-9d64-d2c0297da6f3 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T03:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-470281484',display_name='tempest-TestShelveInstance-server-470281484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-470281484',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGB9kXXZI7btlYKz8qbwCl5qSXx9ePbigaOlVqmnu3Yul5a2sIXzX3Dv0gw8CgASpq/3OhHy3FGVm1xv2CUZ2zpOM8sMMCUsBy/v1w/eT9080f+Qu1oE7h+PZIPBd+H8w==',key_name='tempest-TestShelveInstance-259864335',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2824a9ddbc86494d891293a862669345',ramdisk_id='',reservation_id='r-e1bk2ug6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1788421859',owner_user_name='tempest-TestShelveInstance-1788421859-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:46Z,user_data=None,user_id='e7ec589b1f8c4a7b888e2a4c6b6be9de',uuid=0009e5c8-f604-4057-9d64-d2c0297da6f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converting VIF {"id": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "address": "fa:16:3e:54:35:d0", "network": {"id": "fd637264-fc36-4bf2-82ed-a43065378d0e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1368096469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2824a9ddbc86494d891293a862669345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8abca67-51", "ovs_interfaceid": "c8abca67-51cb-49ec-8ac7-2e1bd18c6792", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_vif [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8abca67-51, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5ef4e26-8c5e-4ec9-b2fe-6fedd36fca2c) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:25 user nova-compute[74836]: INFO os_vif [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:35:d0,bridge_name='br-int',has_traffic_filtering=True,id=c8abca67-51cb-49ec-8ac7-2e1bd18c6792,network=Network(fd637264-fc36-4bf2-82ed-a43065378d0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8abca67-51')
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qMvnESTj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:25 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[67545435-cfb5-4e5d-9451-f8bd7c6a2669]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:54:25 user nova-compute[74836]: No targets found.
Nov 14 03:54:25 user nova-compute[74836]: iSNS:
Nov 14 03:54:25 user nova-compute[74836]: No targets found.
Nov 14 03:54:25 user nova-compute[74836]: STATIC:
Nov 14 03:54:25 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61
Nov 14 03:54:25 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:25 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:25 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770
Nov 14 03:54:25 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:25 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:25 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:54:25 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:25 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:25 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739
Nov 14 03:54:25 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:25 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:25 user nova-compute[74836]: FIRMWARE:
Nov 14 03:54:25 user nova-compute[74836]: No targets found.
Nov 14 03:54:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:54:25 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:54:25 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddb391f-9039-4fc4-b909-f9e1a67120f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e371faf-5fdd-4683-9c84-3bb00cac9a1d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e441d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefb1b4-7883-47bf-8525-1254e4be27bc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c973d68e-cb7a-4369-80d0-8865e8fcb19f]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[99757022-8e5a-4c2a-a342-9826b817b422]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62dca8a-8c68-471d-8aeb-ff95831d13e0]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9aa398-62b0-4144-b8d4-77f4dd795be0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ebe651-efac-4b17-a781-c64f0947e511]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260]
Nov 14 03:54:25 user nova-compute[74836]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa98fcbd-e0ed-428b-957a-18296955bc61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab99aa9b-81aa-4ad4-acee-c376d1c85da5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] <== disconnect_volume: return (303ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:54:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deleting instance files /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3_del
Nov 14 03:54:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deletion of /opt/stack/data/nova/instances/0009e5c8-f604-4057-9d64-d2c0297da6f3_del complete
Nov 14 03:54:25 user nova-compute[74836]: INFO nova.compute.manager [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 03:54:25 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:54:25 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:26 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Took 0.44 seconds to deallocate network for instance.
Nov 14 03:54:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-5c87d556-432b-4e42-bfac-e1f0638107c9 req-968c88f7-5fa3-492c-9d25-0ae3cb9135d7 service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-deleted-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:26 user nova-compute[74836]: INFO nova.compute.manager [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Took 0.76 seconds to detach 1 volumes for instance.
Nov 14 03:54:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Deleting volume: fa98fcbd-e0ed-428b-957a-18296955bc61 {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] Acquiring lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] No waiting events found dispatching network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:54:26 user nova-compute[74836]: WARNING nova.compute.manager [req-3be5c912-4091-4528-9f2d-cb38e998d417 req-255901fc-4b96-42f1-ad56-f0e442a31bad service nova] [instance: 0009e5c8-f604-4057-9d64-d2c0297da6f3] Received unexpected event network-vif-plugged-c8abca67-51cb-49ec-8ac7-2e1bd18c6792 for instance with vm_state active and task_state deleting.
Nov 14 03:54:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:27 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:54:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:54:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:27 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Deleted allocations for instance 0009e5c8-f604-4057-9d64-d2c0297da6f3
Nov 14 03:54:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-23f986d0-239e-416f-ac45-cb694c523341 tempest-TestShelveInstance-1788421859 tempest-TestShelveInstance-1788421859-project-member] Lock "0009e5c8-f604-4057-9d64-d2c0297da6f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.849s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-changed-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Refreshing instance network info cache due to event network-changed-cfbc085f-9b36-49f0-af9f-f0b81242ce2e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] Acquiring lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] Acquired lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Refreshing network info cache for port cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Ignoring supplied device name: /dev/vdb
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:34 user nova-compute[74836]: INFO nova.compute.manager [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Attaching volume d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f to /dev/vdb
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updated VIF entry in instance network info cache for port cfbc085f-9b36-49f0-af9f-f0b81242ce2e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.network.neutron [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updating instance_info_cache with network_info: [{"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f51afc-27b7-4fc5-84cd-426939e35408]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-85549bd9-27ec-4932-b37b-3c170c25b8f6 req-bc3f2b89-38bb-4db0-a269-9d4067629747 service nova] Releasing lock "refresh_cache-39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5a9190-814a-4dfd-bfb9-3b6ef5b06231]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fed2f7-103d-4b70-958b-4cd16588d731]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01010cd-be59-4f05-ab17-e2c0761ebf50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:54:34 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:54:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa0ece9-8cac-4b5f-b14d-a770cde36d8e]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG os_brick.utils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:34 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updating existing volume attachment record: 8ad74cff-18b9-45d0-b04a-6035b665b6e1 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:54:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiDLzZbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:38 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:38 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:38 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[82544ca9-3315-49c0-afe5-c9549c19413a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:54:38 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b436ccaa-0155-47dd-b29c-0928f99073ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f] added
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb84016-a2af-45cc-9f86-6b003513a912]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2687469e-ccaa-43c0-94ce-8a291cbd6814]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiDLzZbp {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiDLzZbp" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbacfd2-7fb6-455a-b14f-183d49524f71]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tiDLzZbp'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dece3b5-cf63-4d5f-8d8d-379926e4d981]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6e515-3421-4bfd-ad0c-bff596b86bd7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7415cab-a6f7-40f1-bd17-0a1bcefbed48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260]
Nov 14 03:54:38 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304f8a1-33dd-496b-aae8-daf393e15811]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a58c3-b3fa-47da-929f-03dc43a83e8f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:38 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:38 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a840c6-09a6-40bc-84a8-bca54a4b2097]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:54:38 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiDLzZbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:54:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23132306562653433', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132306562653433', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:54:39 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 03:54:39 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:39 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:54:39 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:39 user nova-compute[74836]:   <serial>d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f</serial>
Nov 14 03:54:39 user nova-compute[74836]: </disk>
Nov 14 03:54:39 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] No VIF found with MAC fa:16:3e:70:fc:46, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d19ccb7-1062-4915-a45f-d7f4321f2a8b tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.196s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:40 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71b45b07-79ae-4427-a577-da70e027b104 is timed out.
Nov 14 03:54:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Successfully detached device vdb from instance 71b45b07-79ae-4427-a577-da70e027b104 from the live domain config.
Nov 14 03:54:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIWMCicQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:40 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[327e0f90-60d9-44ac-b63f-a45e2f709ab3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:54:40 user nova-compute[74836]: No targets found.
Nov 14 03:54:40 user nova-compute[74836]: iSNS:
Nov 14 03:54:40 user nova-compute[74836]: No targets found.
Nov 14 03:54:40 user nova-compute[74836]: STATIC:
Nov 14 03:54:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770
Nov 14 03:54:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f
Nov 14 03:54:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:54:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:40 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739
Nov 14 03:54:40 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:40 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:40 user nova-compute[74836]: FIRMWARE:
Nov 14 03:54:40 user nova-compute[74836]: No targets found.
Nov 14 03:54:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:54:40 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:54:40 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eac384-474d-4d10-a86c-00239b1265e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f1a82b-c68d-4f3d-a95e-95cce4aa0015]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 (non-flash)
Nov 14 03:54:40 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e441cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770'): ({'sde'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Removing single pathed devices sde {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[13821196-5261-4e77-a613-d659555eb94d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[936ac5c3-aa6b-463b-86f0-4da00b2dce17]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Flushing IO for device /dev/sde {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dfa006-07ec-439d-9b03-f5c7dbd6f8ee]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf3abe8-ede0-4dba-9b9b-c1b2393a33c9]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] SCSI volumes sde have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6068c15-3d53-4299-b3c5-4137eafef8d3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe27c6-aea2-4c1a-985f-e911c34665f4]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260]
Nov 14 03:54:40 user nova-compute[74836]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7946c380-fddd-46c4-9577-7ed83afee770 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[35867d02-ce9e-41b5-be1c-b9fa945c884d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] <== disconnect_volume: return (293ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:54:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:42 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lazy-loading 'flavor' on Instance uuid 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a9077b22-9760-4249-9b5d-e22d09163513 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.971s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'info_cache' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.network.neutron [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:54:44 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance destroyed successfully.
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'resources' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa572516-26, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8dbe7700-136c-4119-95cb-cea353280a19) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:44 user nova-compute[74836]: INFO os_vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 03:54:44 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:44 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4686a-2a81-491b-af6d-436a64ce6746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:54:44 user nova-compute[74836]: No targets found.
Nov 14 03:54:44 user nova-compute[74836]: iSNS:
Nov 14 03:54:44 user nova-compute[74836]: No targets found.
Nov 14 03:54:44 user nova-compute[74836]: STATIC:
Nov 14 03:54:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f
Nov 14 03:54:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:54:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:44 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739
Nov 14 03:54:44 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:54:44 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:54:44 user nova-compute[74836]: FIRMWARE:
Nov 14 03:54:44 user nova-compute[74836]: No targets found.
Nov 14 03:54:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:54:44 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:54:44 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[baacf951-25dd-4592-ae7c-c159f7fe8e6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2f3ed2-e3d9-4221-aa62-42f42323f53e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:44 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:44 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:44 user nova-compute[74836]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:44 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:44 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4467be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[153f4f5d-3dec-4751-8a84-47a787143c81]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4723cc1c-119c-4866-99b0-6bc171327f0a]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7443bc27-4901-4b68-aea6-337db1bbf9b2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:54:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[800d08ee-fb07-4606-b37b-58d037185895]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[60666843-81d8-4a4d-af1b-44708cc7e1ca]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e270b-f0e3-4e1d-b99e-bd38faa25c7a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]
Nov 14 03:54:45 user nova-compute[74836]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4172076d-4a77-4862-ad21-57db952cd9b6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== disconnect_volume: return (308ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start _get_guest_xml network_info=[{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'cda3cfa8-f4db-4ac7-9d14-c9e90740a710', 'attached_at': '', 'detached_at': '', 'volume_id': 'c859770b-cb61-40c8-85b8-be1d25d837a8', 'serial': 'c859770b-cb61-40c8-85b8-be1d25d837a8'}, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'attachment_id': '853722ed-c781-4640-a1bf-4f0908bb01e2', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'numa_topology' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:54:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'vcpu_model' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:54:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:54:45 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2be69ec-51ce-4a51-8ad5-10c780df38ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:54:45 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e82604-f130-4409-a286-ac414bd20704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8] added
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[234864d0-1d3e-4cf0-a4da-5bd0cb42e06b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe83e66-8e14-4343-8b9d-2ed0174a89b0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyDFZMTm {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HyDFZMTm" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[04eb2102-8269-408d-82fd-75f1e4c15ade]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HyDFZMTm'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0457d9e9-1e15-4a90-b512-b5de86712ca8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ed991a-cf32-4858-aca8-95e074b684c7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[30160634-2d46-4959-a070-56897b3b553e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]
Nov 14 03:54:45 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[83939133-3c28-4ab8-9647-e1dc22245c30]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e00b77-ba84-4f22-9b2d-d6e583aacec6]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:54:45 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:54:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f359645-16bb-4855-9e10-64dcdce25bc6]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:54:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23061386566616166', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061386566616166', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'pci_devices' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:54:46 user nova-compute[74836]:   <uuid>cda3cfa8-f4db-4ac7-9d14-c9e90740a710</uuid>
Nov 14 03:54:46 user nova-compute[74836]:   <name>instance-0000002b</name>
Nov 14 03:54:46 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:54:46 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:54:46 user nova-compute[74836]:   <metadata>
Nov 14 03:54:46 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:54:46 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeTestJSON-server-1806491697</nova:name>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:54:45</nova:creationTime>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:54:46 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:54:46 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:owner>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:user uuid="595bbdae7413457ebca1ac2c4c52fe50">tempest-AttachVolumeTestJSON-152008285-project-member</nova:user>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:project uuid="69d6ef35b32a4bfdb1763821cd7776c0">tempest-AttachVolumeTestJSON-152008285</nova:project>
Nov 14 03:54:46 user nova-compute[74836]:       </nova:owner>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:54:46 user nova-compute[74836]:       <nova:ports>
Nov 14 03:54:46 user nova-compute[74836]:         <nova:port uuid="fa572516-26b8-4528-9f55-3d0bdde667df">
Nov 14 03:54:46 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:54:46 user nova-compute[74836]:         </nova:port>
Nov 14 03:54:46 user nova-compute[74836]:       </nova:ports>
Nov 14 03:54:46 user nova-compute[74836]:     </nova:instance>
Nov 14 03:54:46 user nova-compute[74836]:   </metadata>
Nov 14 03:54:46 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:54:46 user nova-compute[74836]:     <system>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="serial">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="uuid">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:54:46 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:54:46 user nova-compute[74836]:     </system>
Nov 14 03:54:46 user nova-compute[74836]:   </sysinfo>
Nov 14 03:54:46 user nova-compute[74836]:   <os>
Nov 14 03:54:46 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:54:46 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:54:46 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:54:46 user nova-compute[74836]:   </os>
Nov 14 03:54:46 user nova-compute[74836]:   <features>
Nov 14 03:54:46 user nova-compute[74836]:     <acpi/>
Nov 14 03:54:46 user nova-compute[74836]:     <apic/>
Nov 14 03:54:46 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:54:46 user nova-compute[74836]:   </features>
Nov 14 03:54:46 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:54:46 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:54:46 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:54:46 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:54:46 user nova-compute[74836]:   </clock>
Nov 14 03:54:46 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:54:46 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:54:46 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:54:46 user nova-compute[74836]:   </cpu>
Nov 14 03:54:46 user nova-compute[74836]:   <devices>
Nov 14 03:54:46 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:54:46 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:54:46 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk"/>
Nov 14 03:54:46 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:54:46 user nova-compute[74836]:     </disk>
Nov 14 03:54:46 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:54:46 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:46 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:54:46 user nova-compute[74836]:       <target dev="vdb" bus="virtio"/>
Nov 14 03:54:46 user nova-compute[74836]:       <serial>c859770b-cb61-40c8-85b8-be1d25d837a8</serial>
Nov 14 03:54:46 user nova-compute[74836]:     </disk>
Nov 14 03:54:46 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:54:46 user nova-compute[74836]:       <mac address="fa:16:3e:26:3c:3e"/>
Nov 14 03:54:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:54:46 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:54:46 user nova-compute[74836]:       <target dev="tapfa572516-26"/>
Nov 14 03:54:46 user nova-compute[74836]:     </interface>
Nov 14 03:54:46 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:54:46 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/console.log" append="off"/>
Nov 14 03:54:46 user nova-compute[74836]:     </serial>
Nov 14 03:54:46 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:54:46 user nova-compute[74836]:     <video>
Nov 14 03:54:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:54:46 user nova-compute[74836]:     </video>
Nov 14 03:54:46 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:54:46 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:54:46 user nova-compute[74836]:     </rng>
Nov 14 03:54:46 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:54:46 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:54:46 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:54:46 user nova-compute[74836]:     </memballoon>
Nov 14 03:54:46 user nova-compute[74836]:   </devices>
Nov 14 03:54:46 user nova-compute[74836]: </domain>
Nov 14 03:54:46 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:46 user nova-compute[74836]: INFO nova.compute.manager [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Detaching volume d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'trusted_certs' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:46 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:47 user nova-compute[74836]: INFO nova.virt.block_device [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Attempting to driver detach volume d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f from mountpoint /dev/vdb
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Attempting to detach device vdb from instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:54:47 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:47 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:54:47 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:47 user nova-compute[74836]:   <serial>d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f</serial>
Nov 14 03:54:47 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:54:47 user nova-compute[74836]: </disk>
Nov 14 03:54:47 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:47 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully detached device vdb from instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 from the persistent domain config.
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:54:47 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:54:47 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 03:54:47 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:54:47 user nova-compute[74836]:   <serial>d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f</serial>
Nov 14 03:54:47 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 03:54:47 user nova-compute[74836]: </disk>
Nov 14 03:54:47 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.185s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Cannot resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.objects.instance [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'migration_context' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.objects.base [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:52:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG os_vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8f0a0a7-2063-586c-b3cf-0433758b6432', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa572516-26, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa572516-26, col_values=(('qos', UUID('886ab9f3-077c-4327-8b39-53570fe3ca0b')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa572516-26, col_values=(('external_ids', {'iface-id': 'fa572516-26b8-4528-9f55-3d0bdde667df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3c:3e', 'vm-uuid': 'cda3cfa8-f4db-4ac7-9d14-c9e90740a710'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:54:47 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:47 user nova-compute[74836]: INFO os_vif [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 03:54:47 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:54:48 user nova-compute[74836]: WARNING nova.compute.manager [req-93571e45-cde7-49ec-9a66-0d7923250445 req-fac66e49-b9b9-4958-b9a2-475e4a18c4c0 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state stopped and task_state powering-on.
Nov 14 03:54:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:54:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:54:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:54:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:54:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:54:50 user nova-compute[74836]: WARNING nova.compute.manager [req-449bd107-e9b4-4c0f-b41c-5b0580156e32 req-1d258afd-e989-4373-b1bb-c14dc26c5ecf service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state stopped and task_state powering-on.
Nov 14 03:54:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:54:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance rebooted successfully.
Nov 14 03:54:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-8a2b3617-f6a3-441d-a4bb-ec85927cde15 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:54:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:54:57 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:02 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:03 user nova-compute[74836]: INFO nova.compute.manager [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Terminating instance
Nov 14 03:55:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-unplugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] No waiting events found dispatching network-vif-unplugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:03 user nova-compute[74836]: DEBUG nova.compute.manager [req-a802e141-e416-4fd3-9689-11bd4a771b1b req-e11ab1b0-03dc-44ee-9b88-7920f74dafd8 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-unplugged-5ab226a4-bb0d-4aef-980f-e6600070b825 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:55:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Instance destroyed successfully.
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid 5895f3d7-3754-401f-9b27-bab9481a543f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:53:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476377613',display_name='tempest-TestVolumeBootPattern-server-476377613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476377613',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-wpex9ca8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:53:29Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=5895f3d7-3754-401f-9b27-bab9481a543f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "5ab226a4-bb0d-4aef-980f-e6600070b825", "address": "fa:16:3e:73:91:0e", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab226a4-bb", "ovs_interfaceid": "5ab226a4-bb0d-4aef-980f-e6600070b825", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_vif [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ab226a4-bb, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d3f0119-54ee-4173-b437-7e2174ead2ea) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:04 user nova-compute[74836]: INFO os_vif [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:91:0e,bridge_name='br-int',has_traffic_filtering=True,id=5ab226a4-bb0d-4aef-980f-e6600070b825,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab226a4-bb')
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VGaEbFeI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:55:04 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f963db-4c29-4247-9499-3ef5beb182b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:55:04 user nova-compute[74836]: No targets found.
Nov 14 03:55:04 user nova-compute[74836]: iSNS:
Nov 14 03:55:04 user nova-compute[74836]: No targets found.
Nov 14 03:55:04 user nova-compute[74836]: STATIC:
Nov 14 03:55:04 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f
Nov 14 03:55:04 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:04 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:04 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:55:04 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:04 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:04 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739
Nov 14 03:55:04 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:04 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:04 user nova-compute[74836]: FIRMWARE:
Nov 14 03:55:04 user nova-compute[74836]: No targets found.
Nov 14 03:55:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:55:04 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:55:04 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[465cf34f-ae66-4667-899b-9ba13430d4d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5cbbf7-8b30-4903-a13b-cc8bd3213e5e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:55:04 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:55:04 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 (non-flash)
Nov 14 03:55:04 user nova-compute[74836]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:55:04 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29eec90160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739'): ({'sdd'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdd {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846c6a0-a496-4bbd-ba7d-2f20f0839eb7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764eac3-c43d-4909-b31b-f4e89fea5e25]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdd {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[89882e7d-cf56-4ce9-a5b5-61ed5e6dc372]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9321d5cb-0b6e-4132-96cd-5bb01fe7f0c4]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdd have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa1c92a59-a683258b939fda83', '/dev/disk/by-id/scsi-26136383332353862', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1c92a59') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc89289-775a-4c2a-92f7-f950faf52d8b]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af5d75e-da8a-4f0b-a830-cd88e176630f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[693d3cf1-92ec-44b8-863c-44917a341e2f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260]
Nov 14 03:55:04 user nova-compute[74836]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739, portal: 172.16.0.220,3260] successful.
Nov 14 03:55:04 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ca5597b9-37f2-4d71-9830-16c726702739 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb162584-8df1-4906-afad-c2d98e48cf93]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (326ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:55:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Deleting instance files /opt/stack/data/nova/instances/5895f3d7-3754-401f-9b27-bab9481a543f_del
Nov 14 03:55:04 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Deletion of /opt/stack/data/nova/instances/5895f3d7-3754-401f-9b27-bab9481a543f_del complete
Nov 14 03:55:04 user nova-compute[74836]: INFO nova.compute.manager [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 03:55:04 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:55:04 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:05 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Took 0.65 seconds to deallocate network for instance.
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e9bcdf0-1c65-4ea0-a27d-7158cf56531b req-acf56cab-1abd-4fc9-ab6d-64bac55e1d10 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-deleted-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:05 user nova-compute[74836]: INFO nova.compute.manager [req-8e9bcdf0-1c65-4ea0-a27d-7158cf56531b req-acf56cab-1abd-4fc9-ab6d-64bac55e1d10 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Neutron deleted interface 5ab226a4-bb0d-4aef-980f-e6600070b825; detaching it from the instance and deleting it from the info cache
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.network.neutron [req-8e9bcdf0-1c65-4ea0-a27d-7158cf56531b req-acf56cab-1abd-4fc9-ab6d-64bac55e1d10 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-8e9bcdf0-1c65-4ea0-a27d-7158cf56531b req-acf56cab-1abd-4fc9-ab6d-64bac55e1d10 service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Detach interface failed, port_id=5ab226a4-bb0d-4aef-980f-e6600070b825, reason: Instance 5895f3d7-3754-401f-9b27-bab9481a543f could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] Acquiring lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] Lock "5895f3d7-3754-401f-9b27-bab9481a543f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] No waiting events found dispatching network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:05 user nova-compute[74836]: WARNING nova.compute.manager [req-98ca2048-a63b-49c3-bd37-a94e01e06c53 req-fca67416-43b8-451e-abf1-54404e32460b service nova] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Received unexpected event network-vif-plugged-5ab226a4-bb0d-4aef-980f-e6600070b825 for instance with vm_state active and task_state deleting.
Nov 14 03:55:05 user nova-compute[74836]: INFO nova.compute.manager [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Took 0.69 seconds to detach 1 volumes for instance.
Nov 14 03:55:05 user nova-compute[74836]: DEBUG nova.compute.manager [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 5895f3d7-3754-401f-9b27-bab9481a543f] Deleting volume: ca5597b9-37f2-4d71-9830-16c726702739 {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:06 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance 5895f3d7-3754-401f-9b27-bab9481a543f
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-1069bffd-b870-4276-8e08-5209e7ea9efa tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "5895f3d7-3754-401f-9b27-bab9481a543f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.956s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:06 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:55:07 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 is timed out.
Nov 14 03:55:07 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully detached device vdb from instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 from the live domain config.
Nov 14 03:55:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiDLzZbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:55:07 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d67296-787b-46fb-b522-bd57e78df3da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:55:07 user nova-compute[74836]: No targets found.
Nov 14 03:55:07 user nova-compute[74836]: iSNS:
Nov 14 03:55:07 user nova-compute[74836]: No targets found.
Nov 14 03:55:07 user nova-compute[74836]: STATIC:
Nov 14 03:55:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f
Nov 14 03:55:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:07 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:55:07 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:07 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:07 user nova-compute[74836]: FIRMWARE:
Nov 14 03:55:07 user nova-compute[74836]: No targets found.
Nov 14 03:55:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:55:07 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:55:07 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[188302fa-aaf7-4e37-9d16-3db2bd2c00e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d116b137-b6a9-4e0c-9cd0-15125cd87524]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:55:07 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f (non-flash)
Nov 14 03:55:07 user nova-compute[74836]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d43e4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[08590997-01d4-4a69-8c28-5f968b3838ab]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514e68a-8fe1-4077-9aaa-a50d5e1be1b0]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283d17a-e692-4a92-ab0a-987eb1b54388]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced65fa-ded2-4b2f-a30a-07b9d848f2be]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[97249400-e8d8-41ce-ae1d-e6c2779b5f5f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[55622456-402e-4382-9c64-3068864940d8]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260]
Nov 14 03:55:07 user nova-compute[74836]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f, portal: 172.16.0.220,3260] successful.
Nov 14 03:55:07 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88e24cc-b953-426a-9dfc-735ea53af609]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== disconnect_volume: return (282ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:55:07 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'flavor' on Instance uuid 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d220d5ea-e01a-4cd9-b7bb-1611656961fa tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.639s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:08 user nova-compute[74836]: INFO nova.compute.manager [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Terminating instance
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-unplugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] No waiting events found dispatching network-vif-unplugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.compute.manager [req-2f76072b-5f63-4ee8-91e8-fa4780dae664 req-3de503d9-a421-482a-a2d5-975782f15a53 service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-unplugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Instance destroyed successfully.
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.objects.instance [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lazy-loading 'resources' on Instance uuid 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-146631268',display_name='tempest-VolumesSnapshotTestJSON-instance-146631268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-146631268',id=45,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJk6GFE4lyOG+iv8h+h6rGp2b+/qlM/Co9B/BHEaEB6L+NG02lfJYedFjAklUI8HaHZwDaPiA3X2+r/0O3Ybjf2fxaLGFnuGu3vUsvhevbb+1kKU+mivc7TRyZmb6Oj3tw==',key_name='tempest-keypair-152086483',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:52:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6991142d39c743fa8ebf2064ae8b3995',ramdisk_id='',reservation_id='r-cee5jwjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1646289946',owner_user_name='tempest-VolumesSnapshotTestJSON-1646289946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b9f79fac66bb40488276060d4b59602d',uuid=39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converting VIF {"id": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "address": "fa:16:3e:70:fc:46", "network": {"id": "c082d7f0-c68f-4d63-b1e3-6e803d7f872a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1046193919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6991142d39c743fa8ebf2064ae8b3995", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcfbc085f-9b", "ovs_interfaceid": "cfbc085f-9b36-49f0-af9f-f0b81242ce2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_vif [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [{"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcfbc085f-9b, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e248d949-1abe-410e-b62d-e44704268dd1) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-71b45b07-79ae-4427-a577-da70e027b104" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:09 user nova-compute[74836]: INFO os_vif [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:fc:46,bridge_name='br-int',has_traffic_filtering=True,id=cfbc085f-9b36-49f0-af9f-f0b81242ce2e,network=Network(c082d7f0-c68f-4d63-b1e3-6e803d7f872a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcfbc085f-9b')
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiDLzZbp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:55:09 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[84642331-4db3-491f-b403-80587dd9ed6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:55:09 user nova-compute[74836]: No targets found.
Nov 14 03:55:09 user nova-compute[74836]: iSNS:
Nov 14 03:55:09 user nova-compute[74836]: No targets found.
Nov 14 03:55:09 user nova-compute[74836]: STATIC:
Nov 14 03:55:09 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:55:09 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:55:09 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:55:09 user nova-compute[74836]: FIRMWARE:
Nov 14 03:55:09 user nova-compute[74836]: No targets found.
Nov 14 03:55:09 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:55:09 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:55:09 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d085caa8-ce5a-4c82-ab0d-2bb1ebeff85f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12cdd41-938d-4b05-8ca8-d75974aefbd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9886ee8f-2805-4539-8869-d4d49c786868]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:09 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:55:09 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4465a20>, {}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Disconnecting from: [] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] <== disconnect_volume: return (66ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:55:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Deleting instance files /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5_del
Nov 14 03:55:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Deletion of /opt/stack/data/nova/instances/39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5_del complete
Nov 14 03:55:09 user nova-compute[74836]: INFO nova.compute.manager [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:09 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:10 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Took 0.74 seconds to deallocate network for instance.
Nov 14 03:55:10 user nova-compute[74836]: WARNING nova.volume.cinder [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Attachment 8ad74cff-18b9-45d0-b04a-6035b665b6e1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8ad74cff-18b9-45d0-b04a-6035b665b6e1. (HTTP 404) (Request-ID: req-e0c30249-087d-4d9d-986d-2fce622dfdbd)
Nov 14 03:55:10 user nova-compute[74836]: INFO nova.compute.manager [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:10 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Deleted allocations for instance 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2884cca0-ff5f-4a3f-a8be-ea27ca4c0967 tempest-VolumesSnapshotTestJSON-1646289946 tempest-VolumesSnapshotTestJSON-1646289946-project-member] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:55:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] Acquiring lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] Lock "39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] No waiting events found dispatching network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:11 user nova-compute[74836]: WARNING nova.compute.manager [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received unexpected event network-vif-plugged-cfbc085f-9b36-49f0-af9f-f0b81242ce2e for instance with vm_state deleted and task_state None.
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-81d0f76d-b0e2-4b6a-b78c-99fd47e9f80d req-610062ae-fa50-435d-bbf2-7f596b344e2d service nova] [instance: 39ef1113-84a4-4da7-bf2b-2cd9fb52f6d5] Received event network-vif-deleted-cfbc085f-9b36-49f0-af9f-f0b81242ce2e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:11 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:55:11 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8623MB free_disk=25.04171371459961GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 71b45b07-79ae-4427-a577-da70e027b104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:55:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:12 user nova-compute[74836]: INFO nova.compute.manager [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Terminating instance
Nov 14 03:55:12 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-1990f65e-da8b-42b7-ae55-58c21ffc9b8e req-95eea82e-c4cc-4936-a07e-b84be6cc214f service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Instance destroyed successfully.
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lazy-loading 'resources' on Instance uuid 71b45b07-79ae-4427-a577-da70e027b104 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:52:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-643807022',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6438070',id=44,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCyrdgakdxwgQs5mGTRKzujtMvDcnYfpxilJmp2YJBSPrdgQ0tCJ+jm/1Mblk8yb1K4LopKjmmwwu1aoZIp48oQ4il9SrvG5yUIjvnqz4XEefVAx5yYDjpQlg/kARTGHJA==',key_name='tempest-keypair-119015600',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:52:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='445604164c76424e9bf337b6d934d679',ramdisk_id='',reservation_id='r-a3y5jpns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3024413bb214165a8c60023c32a0113',uuid=71b45b07-79ae-4427-a577-da70e027b104,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converting VIF {"id": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "address": "fa:16:3e:c1:17:d0", "network": {"id": "81feb6b3-fdb0-4580-b092-489de85ded1c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-358458094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "445604164c76424e9bf337b6d934d679", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48454bd7-7b", "ovs_interfaceid": "48454bd7-7b1d-4f4b-8b05-589df3b69767", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG os_vif [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48454bd7-7b, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=86c05c91-efcc-4f27-9cb5-c39ad6a9093e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:13 user nova-compute[74836]: INFO os_vif [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:17:d0,bridge_name='br-int',has_traffic_filtering=True,id=48454bd7-7b1d-4f4b-8b05-589df3b69767,network=Network(81feb6b3-fdb0-4580-b092-489de85ded1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48454bd7-7b')
Nov 14 03:55:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Deleting instance files /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104_del
Nov 14 03:55:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Deletion of /opt/stack/data/nova/instances/71b45b07-79ae-4427-a577-da70e027b104_del complete
Nov 14 03:55:13 user nova-compute[74836]: INFO nova.compute.manager [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 03:55:13 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:55:13 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:14 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Took 1.00 seconds to deallocate network for instance.
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-11e9fd0d-97d0-49f6-86ae-4c443d500535 req-444eaa2a-4e57-44fb-a61b-b36ee22248f3 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-deleted-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:14 user nova-compute[74836]: INFO nova.compute.manager [req-11e9fd0d-97d0-49f6-86ae-4c443d500535 req-444eaa2a-4e57-44fb-a61b-b36ee22248f3 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Neutron deleted interface 48454bd7-7b1d-4f4b-8b05-589df3b69767; detaching it from the instance and deleting it from the info cache
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-11e9fd0d-97d0-49f6-86ae-4c443d500535 req-444eaa2a-4e57-44fb-a61b-b36ee22248f3 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-11e9fd0d-97d0-49f6-86ae-4c443d500535 req-444eaa2a-4e57-44fb-a61b-b36ee22248f3 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Detach interface failed, port_id=48454bd7-7b1d-4f4b-8b05-589df3b69767, reason: Instance 71b45b07-79ae-4427-a577-da70e027b104 could not be found. {{(pid=74836) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:55:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:14 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Deleted allocations for instance 71b45b07-79ae-4427-a577-da70e027b104
Nov 14 03:55:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a28b68eb-2c76-4ca4-9138-74dac525c463 tempest-TestServerVolumeAttachScenarioOldVersion-795314792 tempest-TestServerVolumeAttachScenarioOldVersion-795314792-project-member] Lock "71b45b07-79ae-4427-a577-da70e027b104" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.236s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:15 user nova-compute[74836]: WARNING nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state deleted and task_state None.
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:15 user nova-compute[74836]: WARNING nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state deleted and task_state None.
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:15 user nova-compute[74836]: WARNING nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state deleted and task_state None.
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:15 user nova-compute[74836]: WARNING nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-unplugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state deleted and task_state None.
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Acquiring lock "71b45b07-79ae-4427-a577-da70e027b104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] Lock "71b45b07-79ae-4427-a577-da70e027b104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:55:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] No waiting events found dispatching network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:55:15 user nova-compute[74836]: WARNING nova.compute.manager [req-4f36e067-f748-4c45-9718-64f73d330fe1 req-22e7dacd-d545-428d-8dda-8af22aaf1119 service nova] [instance: 71b45b07-79ae-4427-a577-da70e027b104] Received unexpected event network-vif-plugged-48454bd7-7b1d-4f4b-8b05-589df3b69767 for instance with vm_state deleted and task_state None.
Nov 14 03:55:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:17 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:55:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:55:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:55:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:55:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:02 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:02 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:56:03 user nova-compute[74836]: INFO nova.compute.claims [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Claim successful on node user
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:56:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:56:03 user nova-compute[74836]: INFO nova.virt.block_device [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Booting with volume cc39b023-2888-4ea1-a3db-3c3aa2ebee34 at /dev/vda
Nov 14 03:56:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.utils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a84cb1f-c7c5-44c3-8d50-d82cf923d353]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413c189-e0a2-4bcf-a249-34987bf0c460]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb307f5-e1ef-48b5-bb3c-03c8094f2d9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5021887b-6df5-409f-85dd-320547e8f139]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.policy [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:56:03 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04be553-f541-44fb-b6f4-70d1347485eb]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG os_brick.utils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating existing volume attachment record: 0ac920c5-dfce-48bf-81b1-06af55043a4a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:56:03 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:04 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Successfully created port: 4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Successfully updated port: 4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-changed-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.compute.manager [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Refreshing instance network info cache due to event network-changed-4f9e9cea-d10a-4f85-9133-02740afa1430. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] Acquiring lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.network.neutron [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Instance network_info: |[{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] Acquired lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG nova.network.neutron [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Refreshing network info cache for port 4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:56:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updated VIF entry in instance network info cache for port 4f9e9cea-d10a-4f85-9133-02740afa1430. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:56:06 user nova-compute[74836]: DEBUG nova.network.neutron [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:56:06 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5d42f2c9-5e93-4bb4-b6b3-4dfc5c53fd51 req-7882e701-8bc5-46e5-baf8-393019e8dd27 service nova] Releasing lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:56:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:07 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:07 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:56:08 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Creating image(s)
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Ensure instance console log exists: /opt/stack/data/nova/instances/f7a3aa34-bb20-43be-a9bb-8c1387d8de99/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Start _get_guest_xml network_info=[{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhAxqWlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7a3aa34-bb20-43be-a9bb-8c1387d8de99', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 'serial': 'cc39b023-2888-4ea1-a3db-3c3aa2ebee34'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '0ac920c5-dfce-48bf-81b1-06af55043a4a', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:56:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:56:08 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhAxqWlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:56:08 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:56:08 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:56:08 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e040980e-ed39-469f-8fa4-c5117ad9b518]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:56:08 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f95491-af00-424e-bcc5-f1567d3ab38b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34] added
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a823a-3005-4ee9-aa1f-de8e0ab1eb29]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89f17b-3847-4ee7-bd93-9455142b33e4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhAxqWlJ {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EhAxqWlJ" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a774ac6e-c9f4-4a3f-b503-2a67bb173e2e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EhAxqWlJ'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb33345-f971-47a1-878c-2a1a94c99828]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba1310-165b-4f0e-9981-f5569ebd9e04]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64542bf-17b6-4d20-bacd-fb84f268c06a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260]
Nov 14 03:56:08 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260] successful.
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa32bd49-53e8-49b9-b7fa-9a180dd11acd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3152805d-2a9f-43d3-a4de-71db098ecc9b]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:56:08 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6521c-07b4-4dad-a5a1-a34bb11037eb]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:56:08 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhAxqWlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23761373939653333', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761373939653333', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1145011830',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQfh3ttGr3J/YMvBnRMlLCGXuU3O3vIHCCgjeH0j/+LetlSp+jFMdmQ8yZQxp9l8+bbrZJ4v/8NlgsSeufAeNJU+uhle9y8o0/YUyUBOuyCbbXG2dyxebkfZb0ItNVGkA==',key_name='tempest-keypair-1504318139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-o9aaj0j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=f7a3aa34-bb20-43be-a9bb-8c1387d8de99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.objects.instance [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid f7a3aa34-bb20-43be-a9bb-8c1387d8de99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:56:09 user nova-compute[74836]:   <uuid>f7a3aa34-bb20-43be-a9bb-8c1387d8de99</uuid>
Nov 14 03:56:09 user nova-compute[74836]:   <name>instance-0000002f</name>
Nov 14 03:56:09 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:56:09 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:56:09 user nova-compute[74836]:   <metadata>
Nov 14 03:56:09 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:56:09 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:56:09 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1145011830</nova:name>
Nov 14 03:56:09 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:56:08</nova:creationTime>
Nov 14 03:56:09 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:56:09 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:56:09 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:56:09 user nova-compute[74836]:       <nova:owner>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 03:56:09 user nova-compute[74836]:       </nova:owner>
Nov 14 03:56:09 user nova-compute[74836]:       <nova:ports>
Nov 14 03:56:09 user nova-compute[74836]:         <nova:port uuid="4f9e9cea-d10a-4f85-9133-02740afa1430">
Nov 14 03:56:09 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 03:56:09 user nova-compute[74836]:         </nova:port>
Nov 14 03:56:09 user nova-compute[74836]:       </nova:ports>
Nov 14 03:56:09 user nova-compute[74836]:     </nova:instance>
Nov 14 03:56:09 user nova-compute[74836]:   </metadata>
Nov 14 03:56:09 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:56:09 user nova-compute[74836]:     <system>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="serial">f7a3aa34-bb20-43be-a9bb-8c1387d8de99</entry>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="uuid">f7a3aa34-bb20-43be-a9bb-8c1387d8de99</entry>
Nov 14 03:56:09 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:56:09 user nova-compute[74836]:     </system>
Nov 14 03:56:09 user nova-compute[74836]:   </sysinfo>
Nov 14 03:56:09 user nova-compute[74836]:   <os>
Nov 14 03:56:09 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:56:09 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:56:09 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:56:09 user nova-compute[74836]:   </os>
Nov 14 03:56:09 user nova-compute[74836]:   <features>
Nov 14 03:56:09 user nova-compute[74836]:     <acpi/>
Nov 14 03:56:09 user nova-compute[74836]:     <apic/>
Nov 14 03:56:09 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:56:09 user nova-compute[74836]:   </features>
Nov 14 03:56:09 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:56:09 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:56:09 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:56:09 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:56:09 user nova-compute[74836]:   </clock>
Nov 14 03:56:09 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:56:09 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:56:09 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:56:09 user nova-compute[74836]:   </cpu>
Nov 14 03:56:09 user nova-compute[74836]:   <devices>
Nov 14 03:56:09 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:56:09 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:56:09 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 03:56:09 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:56:09 user nova-compute[74836]:       <serial>cc39b023-2888-4ea1-a3db-3c3aa2ebee34</serial>
Nov 14 03:56:09 user nova-compute[74836]:     </disk>
Nov 14 03:56:09 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:56:09 user nova-compute[74836]:       <mac address="fa:16:3e:63:ff:63"/>
Nov 14 03:56:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:56:09 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:56:09 user nova-compute[74836]:       <target dev="tap4f9e9cea-d1"/>
Nov 14 03:56:09 user nova-compute[74836]:     </interface>
Nov 14 03:56:09 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:56:09 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/f7a3aa34-bb20-43be-a9bb-8c1387d8de99/console.log" append="off"/>
Nov 14 03:56:09 user nova-compute[74836]:     </serial>
Nov 14 03:56:09 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:56:09 user nova-compute[74836]:     <video>
Nov 14 03:56:09 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:56:09 user nova-compute[74836]:     </video>
Nov 14 03:56:09 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:56:09 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:56:09 user nova-compute[74836]:     </rng>
Nov 14 03:56:09 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:56:09 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:56:09 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:56:09 user nova-compute[74836]:     </memballoon>
Nov 14 03:56:09 user nova-compute[74836]:   </devices>
Nov 14 03:56:09 user nova-compute[74836]: </domain>
Nov 14 03:56:09 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1145011830',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQfh3ttGr3J/YMvBnRMlLCGXuU3O3vIHCCgjeH0j/+LetlSp+jFMdmQ8yZQxp9l8+bbrZJ4v/8NlgsSeufAeNJU+uhle9y8o0/YUyUBOuyCbbXG2dyxebkfZb0ItNVGkA==',key_name='tempest-keypair-1504318139',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-o9aaj0j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:56:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=f7a3aa34-bb20-43be-a9bb-8c1387d8de99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG os_vif [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53e9dbc-06f3-5395-8e3a-bcb6cc8cc1da', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9e9cea-d1, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f9e9cea-d1, col_values=(('qos', UUID('5bcebbd4-8223-493a-9ef9-5083c044288b')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f9e9cea-d1, col_values=(('external_ids', {'iface-id': '4f9e9cea-d10a-4f85-9133-02740afa1430', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:ff:63', 'vm-uuid': 'f7a3aa34-bb20-43be-a9bb-8c1387d8de99'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:09 user nova-compute[74836]: INFO os_vif [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1')
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:63:ff:63, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 03:56:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:10 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG nova.compute.manager [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] No waiting events found dispatching network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:56:11 user nova-compute[74836]: WARNING nova.compute.manager [req-760694a3-6899-4898-99fa-60fd9d6c10d2 req-07960c37-902e-419b-ae81-c659351f016e service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received unexpected event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 for instance with vm_state building and task_state spawning.
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:11 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:56:12 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:56:12 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.057010650634766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:56:12 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:56:13 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Instance spawned successfully.
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.manager [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] No waiting events found dispatching network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:56:13 user nova-compute[74836]: WARNING nova.compute.manager [req-567b4c1e-f612-457a-b9ad-9c517d1f1cfd req-80c431f9-e229-4a34-a15a-1178d092af10 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received unexpected event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 for instance with vm_state building and task_state spawning.
Nov 14 03:56:13 user nova-compute[74836]: INFO nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Took 5.06 seconds to spawn the instance on the hypervisor.
Nov 14 03:56:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:56:13 user nova-compute[74836]: INFO nova.compute.manager [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Took 10.49 seconds to build instance.
Nov 14 03:56:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-48e5a46d-bc38-4e09-b569-47e4e8d86eec tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.701s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:35 user nova-compute[74836]: INFO nova.compute.manager [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Detaching volume c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:56:35 user nova-compute[74836]: INFO nova.virt.block_device [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Attempting to driver detach volume c859770b-cb61-40c8-85b8-be1d25d837a8 from mountpoint /dev/vdb
Nov 14 03:56:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Attempting to detach device vdb from instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 03:56:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:56:35 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:56:35 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:56:35 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:56:35 user nova-compute[74836]:   <serial>c859770b-cb61-40c8-85b8-be1d25d837a8</serial>
Nov 14 03:56:35 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:56:35 user nova-compute[74836]: </disk>
Nov 14 03:56:35 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:56:35 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdb from instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 from the persistent domain config.
Nov 14 03:56:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 03:56:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 03:56:35 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:56:35 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 03:56:35 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 03:56:35 user nova-compute[74836]:   <serial>c859770b-cb61-40c8-85b8-be1d25d837a8</serial>
Nov 14 03:56:35 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 03:56:35 user nova-compute[74836]: </disk>
Nov 14 03:56:35 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 03:56:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 03:56:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:56 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 is timed out.
Nov 14 03:56:56 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdb from instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 from the live domain config.
Nov 14 03:56:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HyDFZMTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:56:56 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b5d9b7-5b00-4c06-9fd7-b4af5f90660c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:56:56 user nova-compute[74836]: No targets found.
Nov 14 03:56:56 user nova-compute[74836]: iSNS:
Nov 14 03:56:56 user nova-compute[74836]: No targets found.
Nov 14 03:56:56 user nova-compute[74836]: STATIC:
Nov 14 03:56:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34
Nov 14 03:56:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:56:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:56:56 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8
Nov 14 03:56:56 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:56:56 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:56:56 user nova-compute[74836]: FIRMWARE:
Nov 14 03:56:56 user nova-compute[74836]: No targets found.
Nov 14 03:56:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:56:56 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:56:56 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3d7d1-e7ca-4297-956f-c968cd218dbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[875b0c13-85c3-4651-a202-8b9e593066e1]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:56 user nova-compute[74836]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:56:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 (non-flash)
Nov 14 03:56:56 user nova-compute[74836]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:56:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4224790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338369f-e17f-4907-bb10-4ca5711a344b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f828be-5c75-4f6d-afdd-6fd889cb943e]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0b2780-1c31-4911-b4d1-2c4c0398c39e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc6e4f-224c-44ea-92af-c80f0b9ae44e]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ae98c-7e44-47eb-8e2c-e6a67708c020]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea1644-5a75-45ad-ae8d-ab2e9b2f6acc]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260]
Nov 14 03:56:56 user nova-compute[74836]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8, portal: 172.16.0.220,3260] successful.
Nov 14 03:56:56 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c859770b-cb61-40c8-85b8-be1d25d837a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40c13a-17e7-443f-9910-29ac89821d69]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== disconnect_volume: return (333ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:56:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:56:57 user nova-compute[74836]: DEBUG nova.objects.instance [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:56:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-09741ea0-bb4f-43e5-a081-19fa474bf491 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74836) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.objects.instance [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.compute.manager [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:56:58 user nova-compute[74836]: WARNING nova.compute.manager [req-094657bb-6b3f-4aca-9621-7b8851b70a34 req-895e8c31-ed40-4455-be28-dc4ee2aa376c service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state active and task_state powering-off.
Nov 14 03:56:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:56:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance destroyed successfully.
Nov 14 03:56:58 user nova-compute[74836]: DEBUG nova.compute.manager [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:56:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-95e7d814-3357-422f-9d48-8e8bd7b50d2d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.823s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:56:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:57:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:00 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:00 user nova-compute[74836]: DEBUG nova.compute.manager [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:57:00 user nova-compute[74836]: WARNING nova.compute.manager [req-0365fc56-9433-49bb-93b5-c954796357c6 req-19f433a9-d74b-4a51-a55b-cf494df82870 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state stopped and task_state None.
Nov 14 03:57:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:57:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:07 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:57:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:10 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:57:10 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:13 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:14 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:57:14 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:57:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.05547332763672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 03:57:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:19 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 03:57:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 03:57:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:24 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:34 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid f7a3aa34-bb20-43be-a9bb-8c1387d8de99 {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:39 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:57:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-changed-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Refreshing instance network info cache due to event network-changed-4f9e9cea-d10a-4f85-9133-02740afa1430. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] Acquiring lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] Acquired lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Refreshing network info cache for port 4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updated VIF entry in instance network info cache for port 4f9e9cea-d10a-4f85-9133-02740afa1430. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG nova.network.neutron [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-750e7360-936e-4cff-9f99-3e5d1d928588 req-c4655092-c90d-41e5-af70-3420c53c7f88 service nova] Releasing lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:57:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:57:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 03:57:59 user nova-compute[74836]: INFO nova.compute.claims [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Claim successful on node user
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 03:57:59 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 03:57:59 user nova-compute[74836]: INFO nova.virt.block_device [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Booting with volume snapshot b0ac7c2f-cd4a-47a3-8105-ca37c04bc2a4 at /dev/vda
Nov 14 03:57:59 user nova-compute[74836]: DEBUG nova.policy [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 03:57:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:00 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Successfully created port: a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Successfully updated port: a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-changed-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Refreshing instance network info cache due to event network-changed-a9e6478e-b4e8-417a-a954-e3f7408e1a9d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] Acquiring lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updating instance_info_cache with network_info: [{"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Instance network_info: |[{"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] Acquired lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Refreshing network info cache for port a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updated VIF entry in instance network info cache for port a9e6478e-b4e8-417a-a954-e3f7408e1a9d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG nova.network.neutron [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updating instance_info_cache with network_info: [{"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:58:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-787b9000-0fd6-4341-af7d-bb8454e171f6 req-ef7fa986-6561-47b8-83b3-46b373de393f service nova] Releasing lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:58:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.utils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61ccdb8-35e7-4ee2-b3df-44238fccf387]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f07cb64-eb43-45a7-b8fe-ee056e0391aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1494ba36-c530-4b5b-85d8-c4a1b8e9ed1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d569f3-4e91-458d-95da-cb568bee0c43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 03:58:05 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff8bc5a-c2a8-4acb-842e-c8878ee93872]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG os_brick.utils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updating existing volume attachment record: b1c5941d-a895-4106-9ca9-e72d017a009a {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 03:58:05 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 03:58:09 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Creating image(s)
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Ensure instance console log exists: /opt/stack/data/nova/instances/557304f4-5957-42b4-b4d6-57b44c1937bc/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Start _get_guest_xml network_info=[{"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T03:57:55Z,direct_url=<?>,disk_format='qcow2',id=05b32961-0bc6-42b8-bbd8-255091d0d75d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-52164975',owner='444ac9d071b74ccca3a0d7e0a5ce9dcd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T03:57:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbpfjOyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '557304f4-5957-42b4-b4d6-57b44c1937bc', 'attached_at': '', 'detached_at': '', 'volume_id': '318d9c8f-1f7f-41ff-949e-64ffe09f5551', 'serial': '318d9c8f-1f7f-41ff-949e-64ffe09f5551'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'b1c5941d-a895-4106-9ca9-e72d017a009a', 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:58:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:09 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T03:57:55Z,direct_url=<?>,disk_format='qcow2',id=05b32961-0bc6-42b8-bbd8-255091d0d75d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-52164975',owner='444ac9d071b74ccca3a0d7e0a5ce9dcd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T03:57:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbpfjOyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:58:09 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:58:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:58:09 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:58:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:58:09 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:58:09 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 03:58:09 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18fcca4-0b9a-4c29-a28d-f906695c06ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 03:58:10 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3806d-f493-436a-be08-6e2fe7277f78]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551] added
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1a9f8-ff9d-4044-993d-9e1af0c4c858]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78339f0-b43a-40ca-9db4-3e46be86eb3c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cbpfjOyS {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cbpfjOyS" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77f1ada-9f43-40b2-95d6-af3145bca471]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cbpfjOyS'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c0276c-b951-46fe-9cf7-247dad7d0d7f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[576146d1-a14c-4f63-85a9-9410992cfcf9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb7f7a-243c-4503-9b5b-0059dce5b26b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260]
Nov 14 03:58:10 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260] successful.
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dec0da-8f76-455c-a3ce-f4fdddd01b3b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276c503-1399-425c-ad39-be568f03dde8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)
Nov 14 03:58:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[446c343e-c88f-4e64-9363-970f1fe6db5b]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:58:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbpfjOyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '23264306530333738', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264306530333738', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1805653861',id=48,image_ref='05b32961-0bc6-42b8-bbd8-255091d0d75d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W/GK7aGNpidG59EDyHi9IGZc4WEEmzQfMYhibTpJN4UiPSynI+b5+yZb+ayjO+eGvY6g4j5BYasVggaYQpZPM0Hr+oplHRVpdTx4SjaCRSE0CDjwaM4csDaWUptX1qA==',key_name='tempest-keypair-2065794028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-un6boxzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1216379953',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=557304f4-5957-42b4-b4d6-57b44c1937bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.objects.instance [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid 557304f4-5957-42b4-b4d6-57b44c1937bc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:58:11 user nova-compute[74836]:   <uuid>557304f4-5957-42b4-b4d6-57b44c1937bc</uuid>
Nov 14 03:58:11 user nova-compute[74836]:   <name>instance-00000030</name>
Nov 14 03:58:11 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:58:11 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:58:11 user nova-compute[74836]:   <metadata>
Nov 14 03:58:11 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:58:11 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1805653861</nova:name>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:58:09</nova:creationTime>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:58:11 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:58:11 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:owner>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 03:58:11 user nova-compute[74836]:       </nova:owner>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:root type="image" uuid="05b32961-0bc6-42b8-bbd8-255091d0d75d"/>
Nov 14 03:58:11 user nova-compute[74836]:       <nova:ports>
Nov 14 03:58:11 user nova-compute[74836]:         <nova:port uuid="a9e6478e-b4e8-417a-a954-e3f7408e1a9d">
Nov 14 03:58:11 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 03:58:11 user nova-compute[74836]:         </nova:port>
Nov 14 03:58:11 user nova-compute[74836]:       </nova:ports>
Nov 14 03:58:11 user nova-compute[74836]:     </nova:instance>
Nov 14 03:58:11 user nova-compute[74836]:   </metadata>
Nov 14 03:58:11 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:58:11 user nova-compute[74836]:     <system>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="serial">557304f4-5957-42b4-b4d6-57b44c1937bc</entry>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="uuid">557304f4-5957-42b4-b4d6-57b44c1937bc</entry>
Nov 14 03:58:11 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:58:11 user nova-compute[74836]:     </system>
Nov 14 03:58:11 user nova-compute[74836]:   </sysinfo>
Nov 14 03:58:11 user nova-compute[74836]:   <os>
Nov 14 03:58:11 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:58:11 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:58:11 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:58:11 user nova-compute[74836]:   </os>
Nov 14 03:58:11 user nova-compute[74836]:   <features>
Nov 14 03:58:11 user nova-compute[74836]:     <acpi/>
Nov 14 03:58:11 user nova-compute[74836]:     <apic/>
Nov 14 03:58:11 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:58:11 user nova-compute[74836]:   </features>
Nov 14 03:58:11 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:58:11 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:58:11 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:58:11 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:58:11 user nova-compute[74836]:   </clock>
Nov 14 03:58:11 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:58:11 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:58:11 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:58:11 user nova-compute[74836]:   </cpu>
Nov 14 03:58:11 user nova-compute[74836]:   <devices>
Nov 14 03:58:11 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 03:58:11 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 03:58:11 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 03:58:11 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:58:11 user nova-compute[74836]:       <serial>318d9c8f-1f7f-41ff-949e-64ffe09f5551</serial>
Nov 14 03:58:11 user nova-compute[74836]:     </disk>
Nov 14 03:58:11 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:58:11 user nova-compute[74836]:       <mac address="fa:16:3e:95:c5:57"/>
Nov 14 03:58:11 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:58:11 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:58:11 user nova-compute[74836]:       <target dev="tapa9e6478e-b4"/>
Nov 14 03:58:11 user nova-compute[74836]:     </interface>
Nov 14 03:58:11 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:58:11 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/557304f4-5957-42b4-b4d6-57b44c1937bc/console.log" append="off"/>
Nov 14 03:58:11 user nova-compute[74836]:     </serial>
Nov 14 03:58:11 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:58:11 user nova-compute[74836]:     <video>
Nov 14 03:58:11 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:58:11 user nova-compute[74836]:     </video>
Nov 14 03:58:11 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:58:11 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:58:11 user nova-compute[74836]:     </rng>
Nov 14 03:58:11 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:58:11 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:58:11 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:58:11 user nova-compute[74836]:     </memballoon>
Nov 14 03:58:11 user nova-compute[74836]:   </devices>
Nov 14 03:58:11 user nova-compute[74836]: </domain>
Nov 14 03:58:11 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1805653861',id=48,image_ref='05b32961-0bc6-42b8-bbd8-255091d0d75d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W/GK7aGNpidG59EDyHi9IGZc4WEEmzQfMYhibTpJN4UiPSynI+b5+yZb+ayjO+eGvY6g4j5BYasVggaYQpZPM0Hr+oplHRVpdTx4SjaCRSE0CDjwaM4csDaWUptX1qA==',key_name='tempest-keypair-2065794028',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-un6boxzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1216379953',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:58:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=557304f4-5957-42b4-b4d6-57b44c1937bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG os_vif [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d3e53c0-ab57-5311-bb2d-cc7b17cc7ce1', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9e6478e-b4, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9e6478e-b4, col_values=(('qos', UUID('466fd82e-5f5b-4fdf-9ef0-4d0dc3095f9a')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9e6478e-b4, col_values=(('external_ids', {'iface-id': 'a9e6478e-b4e8-417a-a954-e3f7408e1a9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:c5:57', 'vm-uuid': '557304f4-5957-42b4-b4d6-57b44c1937bc'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: INFO os_vif [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4')
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:95:c5:57, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] No waiting events found dispatching network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:58:12 user nova-compute[74836]: WARNING nova.compute.manager [req-be24dc5c-4ef6-4443-b6d7-958e34556dae req-068e8498-7f4f-4507-8160-8f74b2df4530 service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received unexpected event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d for instance with vm_state building and task_state spawning.
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:12 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:13 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 03:58:14 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Instance spawned successfully.
Nov 14 03:58:14 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:14 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.053688049316406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] No waiting events found dispatching network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:58:14 user nova-compute[74836]: WARNING nova.compute.manager [req-b78df3cb-2f49-4652-a25b-303a7146bdcf req-bfe91b96-b68a-4f50-9929-7a22250aa8da service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received unexpected event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d for instance with vm_state building and task_state spawning.
Nov 14 03:58:14 user nova-compute[74836]: INFO nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 557304f4-5957-42b4-b4d6-57b44c1937bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:58:14 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:58:15 user nova-compute[74836]: INFO nova.compute.manager [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Took 15.66 seconds to build instance.
Nov 14 03:58:15 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:58:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-fe3893ea-c4d8-40bf-b0d3-c285541bd664 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.761s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:15 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:58:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:58:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:58:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'info_cache' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:48 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.network.neutron [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:58:49 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance destroyed successfully.
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'resources' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG os_vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa572516-26, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=886ab9f3-077c-4327-8b39-53570fe3ca0b) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:49 user nova-compute[74836]: INFO os_vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start _get_guest_xml network_info=[{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'numa_topology' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:49 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'vcpu_model' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'pci_devices' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] End _get_guest_xml xml=<domain type="kvm">
Nov 14 03:58:49 user nova-compute[74836]:   <uuid>cda3cfa8-f4db-4ac7-9d14-c9e90740a710</uuid>
Nov 14 03:58:49 user nova-compute[74836]:   <name>instance-0000002b</name>
Nov 14 03:58:49 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 03:58:49 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 03:58:49 user nova-compute[74836]:   <metadata>
Nov 14 03:58:49 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 03:58:49 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeTestJSON-server-1806491697</nova:name>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:creationTime>2023-11-14 03:58:49</nova:creationTime>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 03:58:49 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 03:58:49 user nova-compute[74836]:       </nova:flavor>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:owner>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:user uuid="595bbdae7413457ebca1ac2c4c52fe50">tempest-AttachVolumeTestJSON-152008285-project-member</nova:user>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:project uuid="69d6ef35b32a4bfdb1763821cd7776c0">tempest-AttachVolumeTestJSON-152008285</nova:project>
Nov 14 03:58:49 user nova-compute[74836]:       </nova:owner>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 03:58:49 user nova-compute[74836]:       <nova:ports>
Nov 14 03:58:49 user nova-compute[74836]:         <nova:port uuid="fa572516-26b8-4528-9f55-3d0bdde667df">
Nov 14 03:58:49 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 03:58:49 user nova-compute[74836]:         </nova:port>
Nov 14 03:58:49 user nova-compute[74836]:       </nova:ports>
Nov 14 03:58:49 user nova-compute[74836]:     </nova:instance>
Nov 14 03:58:49 user nova-compute[74836]:   </metadata>
Nov 14 03:58:49 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 03:58:49 user nova-compute[74836]:     <system>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="serial">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="uuid">cda3cfa8-f4db-4ac7-9d14-c9e90740a710</entry>
Nov 14 03:58:49 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 03:58:49 user nova-compute[74836]:     </system>
Nov 14 03:58:49 user nova-compute[74836]:   </sysinfo>
Nov 14 03:58:49 user nova-compute[74836]:   <os>
Nov 14 03:58:49 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 03:58:49 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 03:58:49 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 03:58:49 user nova-compute[74836]:   </os>
Nov 14 03:58:49 user nova-compute[74836]:   <features>
Nov 14 03:58:49 user nova-compute[74836]:     <acpi/>
Nov 14 03:58:49 user nova-compute[74836]:     <apic/>
Nov 14 03:58:49 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 03:58:49 user nova-compute[74836]:   </features>
Nov 14 03:58:49 user nova-compute[74836]:   <clock offset="utc">
Nov 14 03:58:49 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 03:58:49 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 03:58:49 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 03:58:49 user nova-compute[74836]:   </clock>
Nov 14 03:58:49 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 03:58:49 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 03:58:49 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 03:58:49 user nova-compute[74836]:   </cpu>
Nov 14 03:58:49 user nova-compute[74836]:   <devices>
Nov 14 03:58:49 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 03:58:49 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 03:58:49 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk"/>
Nov 14 03:58:49 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 03:58:49 user nova-compute[74836]:     </disk>
Nov 14 03:58:49 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 03:58:49 user nova-compute[74836]:       <mac address="fa:16:3e:26:3c:3e"/>
Nov 14 03:58:49 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:58:49 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 03:58:49 user nova-compute[74836]:       <target dev="tapfa572516-26"/>
Nov 14 03:58:49 user nova-compute[74836]:     </interface>
Nov 14 03:58:49 user nova-compute[74836]:     <serial type="pty">
Nov 14 03:58:49 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/console.log" append="off"/>
Nov 14 03:58:49 user nova-compute[74836]:     </serial>
Nov 14 03:58:49 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 03:58:49 user nova-compute[74836]:     <video>
Nov 14 03:58:49 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 03:58:49 user nova-compute[74836]:     </video>
Nov 14 03:58:49 user nova-compute[74836]:     <rng model="virtio">
Nov 14 03:58:49 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 03:58:49 user nova-compute[74836]:     </rng>
Nov 14 03:58:49 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 03:58:49 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 03:58:49 user nova-compute[74836]:       <stats period="10"/>
Nov 14 03:58:49 user nova-compute[74836]:     </memballoon>
Nov 14 03:58:49 user nova-compute[74836]:   </devices>
Nov 14 03:58:49 user nova-compute[74836]: </domain>
Nov 14 03:58:49 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'trusted_certs' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Cannot resize image /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.objects.instance [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'migration_context' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.objects.base [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Object Instance<cda3cfa8-f4db-4ac7-9d14-c9e90740a710> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74836) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T03:56:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG os_vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8f0a0a7-2063-586c-b3cf-0433758b6432', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa572516-26, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa572516-26, col_values=(('qos', UUID('44695dcd-3d5f-433a-88d3-83cc3fbaefff')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa572516-26, col_values=(('external_ids', {'iface-id': 'fa572516-26b8-4528-9f55-3d0bdde667df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:3c:3e', 'vm-uuid': 'cda3cfa8-f4db-4ac7-9d14-c9e90740a710'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:58:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:50 user nova-compute[74836]: INFO os_vif [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 03:58:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:51 user nova-compute[74836]: DEBUG nova.compute.manager [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:58:51 user nova-compute[74836]: WARNING nova.compute.manager [req-e1b9070f-e042-43cf-8c8e-21e9931a2cb8 req-96c83f03-b790-4d80-a7a1-027960bdec2b service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state stopped and task_state powering-on.
Nov 14 03:58:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:52 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 03:58:53 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance rebooted successfully.
Nov 14 03:58:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-6369c7a3-03cd-43b7-95f3-60ef476fcab4 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:58:53 user nova-compute[74836]: DEBUG nova.compute.manager [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:58:53 user nova-compute[74836]: WARNING nova.compute.manager [req-04e9ae0d-323f-445f-8778-76ffc881f87a req-50472f72-417c-4d24-8288-b016ad234f7f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state active and task_state None.
Nov 14 03:58:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:58:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:06 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 03:59:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 03:59:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [{"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-cda3cfa8-f4db-4ac7-9d14-c9e90740a710" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:15 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:59:16 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.05205535888672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 557304f4-5957-42b4-b4d6-57b44c1937bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 03:59:16 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 03:59:17 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:59:17 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:59:17 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 03:59:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 03:59:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:59:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:59:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-changed-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Refreshing instance network info cache due to event network-changed-a9e6478e-b4e8-417a-a954-e3f7408e1a9d. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] Acquiring lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] Acquired lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.network.neutron [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Refreshing network info cache for port a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.network.neutron [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updated VIF entry in instance network info cache for port a9e6478e-b4e8-417a-a954-e3f7408e1a9d. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.network.neutron [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updating instance_info_cache with network_info: [{"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-2da2375a-f1aa-42d5-8336-0832728cefbf req-2062a2cf-ba4f-4a60-a76e-302e2e8db06f service nova] Releasing lock "refresh_cache-557304f4-5957-42b4-b4d6-57b44c1937bc" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:50 user nova-compute[74836]: INFO nova.compute.manager [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Terminating instance
Nov 14 03:59:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Instance destroyed successfully.
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.objects.instance [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid 557304f4-5957-42b4-b4d6-57b44c1937bc {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:57:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1805653861',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1805653861',id=48,image_ref='05b32961-0bc6-42b8-bbd8-255091d0d75d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2W/GK7aGNpidG59EDyHi9IGZc4WEEmzQfMYhibTpJN4UiPSynI+b5+yZb+ayjO+eGvY6g4j5BYasVggaYQpZPM0Hr+oplHRVpdTx4SjaCRSE0CDjwaM4csDaWUptX1qA==',key_name='tempest-keypair-2065794028',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:58:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-un6boxzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1216379953',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:58:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=557304f4-5957-42b4-b4d6-57b44c1937bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "address": "fa:16:3e:95:c5:57", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9e6478e-b4", "ovs_interfaceid": "a9e6478e-b4e8-417a-a954-e3f7408e1a9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_vif [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9e6478e-b4, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=466fd82e-5f5b-4fdf-9ef0-4d0dc3095f9a) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 03:59:51 user nova-compute[74836]: INFO os_vif [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:c5:57,bridge_name='br-int',has_traffic_filtering=True,id=a9e6478e-b4e8-417a-a954-e3f7408e1a9d,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9e6478e-b4')
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cbpfjOyS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 03:59:51 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ad8ef4-a2a9-4328-9f1b-4b1c9d52f2c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 03:59:51 user nova-compute[74836]: No targets found.
Nov 14 03:59:51 user nova-compute[74836]: iSNS:
Nov 14 03:59:51 user nova-compute[74836]: No targets found.
Nov 14 03:59:51 user nova-compute[74836]: STATIC:
Nov 14 03:59:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34
Nov 14 03:59:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:59:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:59:51 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551
Nov 14 03:59:51 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 03:59:51 user nova-compute[74836]:                 Iface Name: default
Nov 14 03:59:51 user nova-compute[74836]: FIRMWARE:
Nov 14 03:59:51 user nova-compute[74836]: No targets found.
Nov 14 03:59:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 03:59:51 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 03:59:51 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf84da97-29f3-4040-8809-4658c8669ed5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b405ca-20e9-4c73-b3b7-d74ce9ca6f3d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:59:51 user nova-compute[74836]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)
Nov 14 03:59:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 03:59:51 user nova-compute[74836]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 (non-flash)
Nov 14 03:59:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4302050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9742093-f394-4813-842d-091180852cff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc1529-47db-4f6d-b8c8-925edf4dbe61]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e788ffa-8752-4e49-9137-3f7010908267]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eabdd5c-bdfa-419c-a0ba-73d052ca26a0]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe6b71678-2d0e0378bc2ce5f3', '/dev/disk/by-id/scsi-23264306530333738', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e6b71678') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfc4868-0273-427e-93b2-a1d5a1cd2cae]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3c9fe7-9dfe-4b75-b83f-3087c7e5a2a2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b35e9-60e5-4f18-9935-60f58dcb80fc]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260]
Nov 14 03:59:51 user nova-compute[74836]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551, portal: 172.16.0.220,3260] successful.
Nov 14 03:59:51 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318d9c8f-1f7f-41ff-949e-64ffe09f5551 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ff7a9-9176-4d93-a5b3-d7b46bcde8a6]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (301ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 03:59:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 03:59:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Deleting instance files /opt/stack/data/nova/instances/557304f4-5957-42b4-b4d6-57b44c1937bc_del
Nov 14 03:59:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Deletion of /opt/stack/data/nova/instances/557304f4-5957-42b4-b4d6-57b44c1937bc_del complete
Nov 14 03:59:52 user nova-compute[74836]: INFO nova.compute.manager [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-unplugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] No waiting events found dispatching network-vif-unplugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-unplugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Acquiring lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] No waiting events found dispatching network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 03:59:52 user nova-compute[74836]: WARNING nova.compute.manager [req-21aab48e-97c0-4612-b20d-f097120fe45f req-92fa5bc3-e716-4bf0-aa25-e1ed202060ad service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received unexpected event network-vif-plugged-a9e6478e-b4e8-417a-a954-e3f7408e1a9d for instance with vm_state active and task_state deleting.
Nov 14 03:59:52 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 03:59:52 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Took 0.60 seconds to deallocate network for instance.
Nov 14 03:59:53 user nova-compute[74836]: INFO nova.compute.manager [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 03:59:53 user nova-compute[74836]: DEBUG nova.compute.manager [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Deleting volume: 318d9c8f-1f7f-41ff-949e-64ffe09f5551 {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 03:59:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 03:59:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 03:59:53 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 03:59:53 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 03:59:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:53 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance 557304f4-5957-42b4-b4d6-57b44c1937bc
Nov 14 03:59:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-de7c95f7-7c2e-4749-a06f-273240f857a5 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "557304f4-5957-42b4-b4d6-57b44c1937bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 03:59:54 user nova-compute[74836]: DEBUG nova.compute.manager [req-77d41916-d4aa-48da-ba5e-76f299b9f257 req-8b1f5ed3-da5f-41c6-bc92-7882c1b615b8 service nova] [instance: 557304f4-5957-42b4-b4d6-57b44c1937bc] Received event network-vif-deleted-a9e6478e-b4e8-417a-a954-e3f7408e1a9d {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 03:59:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:08 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:00:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [{"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-f7a3aa34-bb20-43be-a9bb-8c1387d8de99" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:17 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:00:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.051128387451172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:00:18 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:00:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:00:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:39 user nova-compute[74836]: INFO nova.compute.manager [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Terminating instance
Nov 14 04:00:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.compute.manager [req-28bf051b-dfb7-4d19-b40e-5a465c90a530 req-f90532d4-a642-4b8a-bae4-83c92666a19f service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-unplugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Instance destroyed successfully.
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.objects.instance [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'resources' on Instance uuid cda3cfa8-f4db-4ac7-9d14-c9e90740a710 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1806491697',display_name='tempest-AttachVolumeTestJSON-server-1806491697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1806491697',id=43,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1JSRlAPiJBhEfEoiMB0Na9dHohaJfhVLyusuE8mqJVlLABX6nY5TirJAMCzmYQo3uYy/A92cUYtX2+qqEv5KtTIDSRiw03pNQfUup3k30u0+YPxQRa5NlQ7dWCMcTsoA==',key_name='tempest-keypair-1699500225',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-tmfnelry',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=cda3cfa8-f4db-4ac7-9d14-c9e90740a710,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "fa572516-26b8-4528-9f55-3d0bdde667df", "address": "fa:16:3e:26:3c:3e", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa572516-26", "ovs_interfaceid": "fa572516-26b8-4528-9f55-3d0bdde667df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG os_vif [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa572516-26, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44695dcd-3d5f-433a-88d3-83cc3fbaefff) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:40 user nova-compute[74836]: INFO os_vif [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:3c:3e,bridge_name='br-int',has_traffic_filtering=True,id=fa572516-26b8-4528-9f55-3d0bdde667df,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa572516-26')
Nov 14 04:00:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Deleting instance files /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710_del
Nov 14 04:00:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Deletion of /opt/stack/data/nova/instances/cda3cfa8-f4db-4ac7-9d14-c9e90740a710_del complete
Nov 14 04:00:40 user nova-compute[74836]: INFO nova.compute.manager [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 04:00:40 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:00:40 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:00:41 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Took 0.97 seconds to deallocate network for instance.
Nov 14 04:00:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-7510c9c2-08f5-452e-96e5-a2a4a4c26e14 req-821c4990-46e6-4351-b876-d7164e3e3ab4 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-deleted-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:00:41 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:42 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Deleted allocations for instance cda3cfa8-f4db-4ac7-9d14-c9e90740a710
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-d8a7a432-71ff-4992-a51c-81e62a261f90 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.153s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] Acquiring lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] Lock "cda3cfa8-f4db-4ac7-9d14-c9e90740a710-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] No waiting events found dispatching network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:00:42 user nova-compute[74836]: WARNING nova.compute.manager [req-f40bda07-5263-449c-a216-d55cecab7321 req-064b551b-dae7-4460-976b-a6f8155f4e02 service nova] [instance: cda3cfa8-f4db-4ac7-9d14-c9e90740a710] Received unexpected event network-vif-plugged-fa572516-26b8-4528-9f55-3d0bdde667df for instance with vm_state deleted and task_state None.
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:42 user nova-compute[74836]: INFO nova.compute.manager [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Terminating instance
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-unplugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] No waiting events found dispatching network-vif-unplugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:00:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-9879272d-d313-4022-b901-7f156c8ecc79 req-d947df64-c82e-46ac-aa19-14e55a128041 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-unplugged-4f9e9cea-d10a-4f85-9133-02740afa1430 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Instance destroyed successfully.
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid f7a3aa34-bb20-43be-a9bb-8c1387d8de99 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T03:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1145011830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1145011830',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQfh3ttGr3J/YMvBnRMlLCGXuU3O3vIHCCgjeH0j/+LetlSp+jFMdmQ8yZQxp9l8+bbrZJ4v/8NlgsSeufAeNJU+uhle9y8o0/YUyUBOuyCbbXG2dyxebkfZb0ItNVGkA==',key_name='tempest-keypair-1504318139',keypairs=<?>,launch_index=0,launched_at=2023-11-14T03:56:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-o9aaj0j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T03:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb40ab0c80664eb5864a57683542943c',uuid=f7a3aa34-bb20-43be-a9bb-8c1387d8de99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "4f9e9cea-d10a-4f85-9133-02740afa1430", "address": "fa:16:3e:63:ff:63", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9e9cea-d1", "ovs_interfaceid": "4f9e9cea-d10a-4f85-9133-02740afa1430", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_vif [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9e9cea-d1, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bcebbd4-8223-493a-9ef9-5083c044288b) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:43 user nova-compute[74836]: INFO os_vif [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:ff:63,bridge_name='br-int',has_traffic_filtering=True,id=4f9e9cea-d10a-4f85-9133-02740afa1430,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9e9cea-d1')
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EhAxqWlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:00:43 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1d1ba-f78a-495b-a100-c555ba77293f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:00:43 user nova-compute[74836]: No targets found.
Nov 14 04:00:43 user nova-compute[74836]: iSNS:
Nov 14 04:00:43 user nova-compute[74836]: No targets found.
Nov 14 04:00:43 user nova-compute[74836]: STATIC:
Nov 14 04:00:43 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34
Nov 14 04:00:43 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:00:43 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:00:43 user nova-compute[74836]: FIRMWARE:
Nov 14 04:00:43 user nova-compute[74836]: No targets found.
Nov 14 04:00:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:00:43 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:00:43 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0057c335-0d90-47f8-9d5a-5e7215359763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18e41a-3b1c-496d-9d0d-ae3249883348]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 04:00:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 (non-flash)
Nov 14 04:00:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4465900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfa6e4-87ac-4ef7-887f-7415f414c47f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[03681e22-cb8c-419f-9307-9dd44e9e741b]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[77685ff4-eaf7-47ba-9a41-7e68763a1f99]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a515d9-ea28-45ef-9158-f78746d37cfd]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[76285fd0-7fe6-4795-8de9-794357a89d75]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d04126-29b9-433d-9163-4c07b5e74662]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260]
Nov 14 04:00:43 user nova-compute[74836]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34, portal: 172.16.0.220,3260] successful.
Nov 14 04:00:43 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc39b023-2888-4ea1-a3db-3c3aa2ebee34 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bff171-6fe3-47be-885b-1952d18aebf4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (308ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:00:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Deleting instance files /opt/stack/data/nova/instances/f7a3aa34-bb20-43be-a9bb-8c1387d8de99_del
Nov 14 04:00:43 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Deletion of /opt/stack/data/nova/instances/f7a3aa34-bb20-43be-a9bb-8c1387d8de99_del complete
Nov 14 04:00:43 user nova-compute[74836]: INFO nova.compute.manager [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 14 04:00:43 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:00:43 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:00:44 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Took 0.73 seconds to deallocate network for instance.
Nov 14 04:00:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-4dc42b38-026b-4f8f-9b89-fd7a3a232197 req-d8c835c8-b099-4c7f-bc01-a84e093c4afb service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-deleted-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] Acquiring lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:44 user nova-compute[74836]: DEBUG nova.compute.manager [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] No waiting events found dispatching network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:00:44 user nova-compute[74836]: WARNING nova.compute.manager [req-4bd69725-c161-42a2-a2a0-caf3537ac2e2 req-4185c8ad-8980-4233-b3d1-b6866bf2dfa2 service nova] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Received unexpected event network-vif-plugged-4f9e9cea-d10a-4f85-9133-02740afa1430 for instance with vm_state active and task_state deleting.
Nov 14 04:00:45 user nova-compute[74836]: INFO nova.compute.manager [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Took 0.67 seconds to detach 1 volumes for instance.
Nov 14 04:00:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: f7a3aa34-bb20-43be-a9bb-8c1387d8de99] Deleting volume: cc39b023-2888-4ea1-a3db-3c3aa2ebee34 {{(pid=74836) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 04:00:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:00:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:00:45 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:00:45 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:00:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:45 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance f7a3aa34-bb20-43be-a9bb-8c1387d8de99
Nov 14 04:00:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a14d34c0-c99d-4b50-b380-81cc34ab6676 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "f7a3aa34-bb20-43be-a9bb-8c1387d8de99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.010s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:00:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:00:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:00:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:01:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:01:10 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:17 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9147MB free_disk=25.078327178955078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:01:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:01:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:33 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:01:33 user nova-compute[74836]: INFO nova.compute.claims [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Claim successful on node user
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:01:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:01:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Creating image(s)
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "/opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "/opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "/opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.policy [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '595bbdae7413457ebca1ac2c4c52fe50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69d6ef35b32a4bfdb1763821cd7776c0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.170s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.172s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk 1073741824" returned: 0 in 0.056s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:01:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Cannot resize image /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Ensure instance console log exists: /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Successfully created port: 85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Successfully updated port: 85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquired lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.compute.manager [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-changed-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.compute.manager [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Refreshing instance network info cache due to event network-changed-85aec954-7c4c-4511-9cdf-a87df9d96bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] Acquiring lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:01:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.neutron [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Releasing lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Instance network_info: |[{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] Acquired lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.neutron [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Refreshing network info cache for port 85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Start _get_guest_xml network_info=[{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:01:36 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:36 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-815731132',display_name='tempest-AttachVolumeTestJSON-server-815731132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-815731132',id=49,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbV2cf8dnmmkMp/hzSCXascK1Ok+I4hp/6VdxdiMr3rxDQdG+x5bJ706RA9Y7ir97QhGa6Frqk81Dq9fLre/0mnhyFXu7F1a/Ctm+tJYWO8+XjBuDyDX06cBf9u8ZJIEg==',key_name='tempest-keypair-1295019211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-b7mx4hdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=1165987b-8a1c-48ed-9144-4dc8e73be1b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.objects.instance [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'pci_devices' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:01:36 user nova-compute[74836]:   <uuid>1165987b-8a1c-48ed-9144-4dc8e73be1b5</uuid>
Nov 14 04:01:36 user nova-compute[74836]:   <name>instance-00000031</name>
Nov 14 04:01:36 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 04:01:36 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 04:01:36 user nova-compute[74836]:   <metadata>
Nov 14 04:01:36 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:01:36 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:name>tempest-AttachVolumeTestJSON-server-815731132</nova:name>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:creationTime>2023-11-14 04:01:36</nova:creationTime>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 04:01:36 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:01:36 user nova-compute[74836]:       </nova:flavor>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:owner>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:user uuid="595bbdae7413457ebca1ac2c4c52fe50">tempest-AttachVolumeTestJSON-152008285-project-member</nova:user>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:project uuid="69d6ef35b32a4bfdb1763821cd7776c0">tempest-AttachVolumeTestJSON-152008285</nova:project>
Nov 14 04:01:36 user nova-compute[74836]:       </nova:owner>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 04:01:36 user nova-compute[74836]:       <nova:ports>
Nov 14 04:01:36 user nova-compute[74836]:         <nova:port uuid="85aec954-7c4c-4511-9cdf-a87df9d96bd6">
Nov 14 04:01:36 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 04:01:36 user nova-compute[74836]:         </nova:port>
Nov 14 04:01:36 user nova-compute[74836]:       </nova:ports>
Nov 14 04:01:36 user nova-compute[74836]:     </nova:instance>
Nov 14 04:01:36 user nova-compute[74836]:   </metadata>
Nov 14 04:01:36 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 04:01:36 user nova-compute[74836]:     <system>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="serial">1165987b-8a1c-48ed-9144-4dc8e73be1b5</entry>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="uuid">1165987b-8a1c-48ed-9144-4dc8e73be1b5</entry>
Nov 14 04:01:36 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:01:36 user nova-compute[74836]:     </system>
Nov 14 04:01:36 user nova-compute[74836]:   </sysinfo>
Nov 14 04:01:36 user nova-compute[74836]:   <os>
Nov 14 04:01:36 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:01:36 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 04:01:36 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 04:01:36 user nova-compute[74836]:   </os>
Nov 14 04:01:36 user nova-compute[74836]:   <features>
Nov 14 04:01:36 user nova-compute[74836]:     <acpi/>
Nov 14 04:01:36 user nova-compute[74836]:     <apic/>
Nov 14 04:01:36 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 04:01:36 user nova-compute[74836]:   </features>
Nov 14 04:01:36 user nova-compute[74836]:   <clock offset="utc">
Nov 14 04:01:36 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:01:36 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:01:36 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 04:01:36 user nova-compute[74836]:   </clock>
Nov 14 04:01:36 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 04:01:36 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 04:01:36 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:01:36 user nova-compute[74836]:   </cpu>
Nov 14 04:01:36 user nova-compute[74836]:   <devices>
Nov 14 04:01:36 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 04:01:36 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:01:36 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk"/>
Nov 14 04:01:36 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 04:01:36 user nova-compute[74836]:     </disk>
Nov 14 04:01:36 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 04:01:36 user nova-compute[74836]:       <mac address="fa:16:3e:ff:30:d0"/>
Nov 14 04:01:36 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:01:36 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 04:01:36 user nova-compute[74836]:       <target dev="tap85aec954-7c"/>
Nov 14 04:01:36 user nova-compute[74836]:     </interface>
Nov 14 04:01:36 user nova-compute[74836]:     <serial type="pty">
Nov 14 04:01:36 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/console.log" append="off"/>
Nov 14 04:01:36 user nova-compute[74836]:     </serial>
Nov 14 04:01:36 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:01:36 user nova-compute[74836]:     <video>
Nov 14 04:01:36 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:01:36 user nova-compute[74836]:     </video>
Nov 14 04:01:36 user nova-compute[74836]:     <rng model="virtio">
Nov 14 04:01:36 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:01:36 user nova-compute[74836]:     </rng>
Nov 14 04:01:36 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:01:36 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 04:01:36 user nova-compute[74836]:       <stats period="10"/>
Nov 14 04:01:36 user nova-compute[74836]:     </memballoon>
Nov 14 04:01:36 user nova-compute[74836]:   </devices>
Nov 14 04:01:36 user nova-compute[74836]: </domain>
Nov 14 04:01:36 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-815731132',display_name='tempest-AttachVolumeTestJSON-server-815731132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-815731132',id=49,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbV2cf8dnmmkMp/hzSCXascK1Ok+I4hp/6VdxdiMr3rxDQdG+x5bJ706RA9Y7ir97QhGa6Frqk81Dq9fLre/0mnhyFXu7F1a/Ctm+tJYWO8+XjBuDyDX06cBf9u8ZJIEg==',key_name='tempest-keypair-1295019211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-b7mx4hdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=1165987b-8a1c-48ed-9144-4dc8e73be1b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG os_vif [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26613f2b-5779-525a-8608-322f3d684268', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85aec954-7c, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85aec954-7c, col_values=(('qos', UUID('6094a0f1-2aa5-4eed-a061-fb44017ff17f')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85aec954-7c, col_values=(('external_ids', {'iface-id': '85aec954-7c4c-4511-9cdf-a87df9d96bd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:30:d0', 'vm-uuid': '1165987b-8a1c-48ed-9144-4dc8e73be1b5'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:36 user nova-compute[74836]: INFO os_vif [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c')
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No VIF found with MAC fa:16:3e:ff:30:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.neutron [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updated VIF entry in instance network info cache for port 85aec954-7c4c-4511-9cdf-a87df9d96bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG nova.network.neutron [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:01:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-131b2024-124d-47fd-be2b-e2f3d5a3cf3d req-3bb14c00-d560-40a8-86c4-0642e9ff1b48 service nova] Releasing lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:37 user nova-compute[74836]: DEBUG nova.compute.manager [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] No waiting events found dispatching network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:01:37 user nova-compute[74836]: WARNING nova.compute.manager [req-8ed106c0-b457-43bb-8448-b5d7b25aa059 req-445d31a2-8885-4228-9b87-6591391e05aa service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received unexpected event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 for instance with vm_state building and task_state spawning.
Nov 14 04:01:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:01:39 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Instance spawned successfully.
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.compute.manager [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] No waiting events found dispatching network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:01:39 user nova-compute[74836]: WARNING nova.compute.manager [req-b9e3262a-3d93-4344-bb37-53d46adbb7c1 req-b8f3ca4b-1ee1-4061-8c3e-1bcd0ab5f2db service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received unexpected event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 for instance with vm_state building and task_state spawning.
Nov 14 04:01:39 user nova-compute[74836]: INFO nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 14 04:01:39 user nova-compute[74836]: DEBUG nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:01:39 user nova-compute[74836]: INFO nova.compute.manager [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Took 5.99 seconds to build instance.
Nov 14 04:01:39 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-c442cdc9-7cc6-4056-815e-81ff49c7c358 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.078s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:01:40 user nova-compute[74836]: INFO nova.compute.claims [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Claim successful on node user
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:01:40 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG nova.policy [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:01:40 user nova-compute[74836]: INFO nova.virt.block_device [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Booting with volume 49be29d2-470a-4d48-8f4c-81c1d2903984 at /dev/vda
Nov 14 04:01:40 user nova-compute[74836]: DEBUG os_brick.utils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff7a84-8ee6-402a-a05d-c8450903886b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd288c-457b-4234-89b3-181b4acd2206]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ee1513-2bac-4f01-b8b2-6e848a8f330d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[307603ef-32e0-402f-b546-9c1e8ab8bd5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:01:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:01:41 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:01:41 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f38862-2894-460e-b844-2371d8b54f93]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG os_brick.utils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating existing volume attachment record: 9e39e99c-a821-4f58-9f69-14d55b14033f {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Successfully created port: 21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:01:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Successfully updated port: 21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-changed-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.compute.manager [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Refreshing instance network info cache due to event network-changed-21febddc-2267-4598-b86c-34be59056657. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] Acquiring lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating instance_info_cache with network_info: [{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Instance network_info: |[{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] Acquired lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Refreshing network info cache for port 21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updated VIF entry in instance network info cache for port 21febddc-2267-4598-b86c-34be59056657. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG nova.network.neutron [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating instance_info_cache with network_info: [{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:01:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-47fdf72f-290e-49a3-8e0f-ff5c910cc462 req-74c390eb-a2c2-45cb-9d42-8b52c8dfb390 service nova] Releasing lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:01:45 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Creating image(s)
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Ensure instance console log exists: /opt/stack/data/nova/instances/d2cbd112-55bd-451a-843e-636481740b7a/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Start _get_guest_xml network_info=[{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2cbd112-55bd-451a-843e-636481740b7a', 'attached_at': '', 'detached_at': '', 'volume_id': '49be29d2-470a-4d48-8f4c-81c1d2903984', 'serial': '49be29d2-470a-4d48-8f4c-81c1d2903984'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '9e39e99c-a821-4f58-9f69-14d55b14033f', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:01:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:45 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:01:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:01:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:01:45 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af69e2f-bbec-44ba-9c20-d2c57dbc9ff3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:01:45 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[20854fef-de5e-4b56-ae3f-2783654f8558]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984] added
Nov 14 04:01:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd219d-812d-4a68-9cde-5f8f9edfbdf9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1194b123-819d-4ec3-a0eb-3236824e5f40]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBaEWOpf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBaEWOpf" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[648becd5-6c8c-495c-9f39-fca517b84f31]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBaEWOpf'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[640af6a7-2433-45a4-a679-b2ee70d0a55f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe922a2-5e10-4206-8cb9-b127a17ad916]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:01:45 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:01:45 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:01:45 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:01:45 user nova-compute[74836]: 
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8df358f-3603-45e2-9986-d75656821331]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]
Nov 14 04:01:45 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.
Nov 14 04:01:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8219b941-0247-47d0-8121-94931dedc6d0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[66438470-7bd6-4d44-9481-f4ba02dc692c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:01:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:01:45 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.227s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1cb10-05f3-4a77-b060-75debfa9263b]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:01:45 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.253s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1254ms) {'type': 'block', 'scsi_wwn': '23963383330373263', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963383330373263', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577664153',display_name='tempest-TestVolumeBootPattern-server-1577664153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577664153',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-v5m5hb7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:01:41Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=d2cbd112-55bd-451a-843e-636481740b7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.objects.instance [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid d2cbd112-55bd-451a-843e-636481740b7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:01:46 user nova-compute[74836]:   <uuid>d2cbd112-55bd-451a-843e-636481740b7a</uuid>
Nov 14 04:01:46 user nova-compute[74836]:   <name>instance-00000032</name>
Nov 14 04:01:46 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 04:01:46 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 04:01:46 user nova-compute[74836]:   <metadata>
Nov 14 04:01:46 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:01:46 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 04:01:46 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-server-1577664153</nova:name>
Nov 14 04:01:46 user nova-compute[74836]:       <nova:creationTime>2023-11-14 04:01:45</nova:creationTime>
Nov 14 04:01:46 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 04:01:46 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:01:46 user nova-compute[74836]:       </nova:flavor>
Nov 14 04:01:46 user nova-compute[74836]:       <nova:owner>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 04:01:46 user nova-compute[74836]:       </nova:owner>
Nov 14 04:01:46 user nova-compute[74836]:       <nova:ports>
Nov 14 04:01:46 user nova-compute[74836]:         <nova:port uuid="21febddc-2267-4598-b86c-34be59056657">
Nov 14 04:01:46 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 04:01:46 user nova-compute[74836]:         </nova:port>
Nov 14 04:01:46 user nova-compute[74836]:       </nova:ports>
Nov 14 04:01:46 user nova-compute[74836]:     </nova:instance>
Nov 14 04:01:46 user nova-compute[74836]:   </metadata>
Nov 14 04:01:46 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 04:01:46 user nova-compute[74836]:     <system>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="serial">d2cbd112-55bd-451a-843e-636481740b7a</entry>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="uuid">d2cbd112-55bd-451a-843e-636481740b7a</entry>
Nov 14 04:01:46 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:01:46 user nova-compute[74836]:     </system>
Nov 14 04:01:46 user nova-compute[74836]:   </sysinfo>
Nov 14 04:01:46 user nova-compute[74836]:   <os>
Nov 14 04:01:46 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:01:46 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 04:01:46 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 04:01:46 user nova-compute[74836]:   </os>
Nov 14 04:01:46 user nova-compute[74836]:   <features>
Nov 14 04:01:46 user nova-compute[74836]:     <acpi/>
Nov 14 04:01:46 user nova-compute[74836]:     <apic/>
Nov 14 04:01:46 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 04:01:46 user nova-compute[74836]:   </features>
Nov 14 04:01:46 user nova-compute[74836]:   <clock offset="utc">
Nov 14 04:01:46 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:01:46 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:01:46 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 04:01:46 user nova-compute[74836]:   </clock>
Nov 14 04:01:46 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 04:01:46 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 04:01:46 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:01:46 user nova-compute[74836]:   </cpu>
Nov 14 04:01:46 user nova-compute[74836]:   <devices>
Nov 14 04:01:46 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 04:01:46 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:01:46 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 04:01:46 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 04:01:46 user nova-compute[74836]:       <serial>49be29d2-470a-4d48-8f4c-81c1d2903984</serial>
Nov 14 04:01:46 user nova-compute[74836]:     </disk>
Nov 14 04:01:46 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 04:01:46 user nova-compute[74836]:       <mac address="fa:16:3e:62:73:f5"/>
Nov 14 04:01:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:01:46 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 04:01:46 user nova-compute[74836]:       <target dev="tap21febddc-22"/>
Nov 14 04:01:46 user nova-compute[74836]:     </interface>
Nov 14 04:01:46 user nova-compute[74836]:     <serial type="pty">
Nov 14 04:01:46 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/d2cbd112-55bd-451a-843e-636481740b7a/console.log" append="off"/>
Nov 14 04:01:46 user nova-compute[74836]:     </serial>
Nov 14 04:01:46 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:01:46 user nova-compute[74836]:     <video>
Nov 14 04:01:46 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:01:46 user nova-compute[74836]:     </video>
Nov 14 04:01:46 user nova-compute[74836]:     <rng model="virtio">
Nov 14 04:01:46 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:01:46 user nova-compute[74836]:     </rng>
Nov 14 04:01:46 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:01:46 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 04:01:46 user nova-compute[74836]:       <stats period="10"/>
Nov 14 04:01:46 user nova-compute[74836]:     </memballoon>
Nov 14 04:01:46 user nova-compute[74836]:   </devices>
Nov 14 04:01:46 user nova-compute[74836]: </domain>
Nov 14 04:01:46 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577664153',display_name='tempest-TestVolumeBootPattern-server-1577664153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577664153',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-v5m5hb7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:01:41Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=d2cbd112-55bd-451a-843e-636481740b7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG os_vif [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49a20356-0909-5fa3-a984-2d5273deccb2', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21febddc-22, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21febddc-22, col_values=(('qos', UUID('d731c850-b977-4455-a0e4-0e16e57a3567')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21febddc-22, col_values=(('external_ids', {'iface-id': '21febddc-2267-4598-b86c-34be59056657', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:73:f5', 'vm-uuid': 'd2cbd112-55bd-451a-843e-636481740b7a'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:46 user nova-compute[74836]: INFO os_vif [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22')
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:01:46 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:62:73:f5, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG nova.compute.manager [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] No waiting events found dispatching network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:01:48 user nova-compute[74836]: WARNING nova.compute.manager [req-363e5bc7-76fb-4071-9d16-a69ecc4738f8 req-c3977ce0-3241-4d2a-a5fa-b7806b81198f service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received unexpected event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 for instance with vm_state building and task_state spawning.
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:01:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Instance spawned successfully.
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.compute.manager [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] No waiting events found dispatching network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:01:50 user nova-compute[74836]: WARNING nova.compute.manager [req-55853df5-5745-465a-ab04-29e1a5d21c0d req-44dfaff6-b091-41a2-a331-a8f5f0883ed8 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received unexpected event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 for instance with vm_state building and task_state spawning.
Nov 14 04:01:50 user nova-compute[74836]: INFO nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 14 04:01:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:01:50 user nova-compute[74836]: INFO nova.compute.manager [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Took 10.05 seconds to build instance.
Nov 14 04:01:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-04f3c083-3e48-4a7d-8151-81da3d32decc tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.169s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:01:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:01:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:02:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:02:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:02:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:02:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:02:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:02:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=25.039203643798828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance d2cbd112-55bd-451a-843e-636481740b7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:02:19 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:02:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:02:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:27 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:02:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:02:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:02:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:08 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:11 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:03:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:18 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:03:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:03:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8922MB free_disk=25.038604736328125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance d2cbd112-55bd-451a-843e-636481740b7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:03:19 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:03:20 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:03:20 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:03:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating instance_info_cache with network_info: [{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-changed-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:03:24 user nova-compute[74836]: DEBUG nova.compute.manager [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Refreshing instance network info cache due to event network-changed-85aec954-7c4c-4511-9cdf-a87df9d96bd6. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:03:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] Acquiring lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:03:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] Acquired lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:03:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Refreshing network info cache for port 85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:03:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updated VIF entry in instance network info cache for port 85aec954-7c4c-4511-9cdf-a87df9d96bd6. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:03:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:03:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9895e732-c0f5-4828-bfc2-307c512039b5 req-df58d790-5065-4fbf-a4bb-6ab265a98750 service nova] Releasing lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:03:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:27 user nova-compute[74836]: INFO nova.compute.manager [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attaching volume c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 to /dev/vdb
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.utils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d69d9e7-1191-4d8c-8759-8c85c8b94c42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80831e-acb3-4bf3-baf8-3c7daabee658]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c4a990-26af-4177-af4f-daceb503644a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a34efd-201e-498b-b92d-001ec9f11c03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:03:27 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:03:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fe06c3-b4af-4d49-b734-2bf27549fdd0]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG os_brick.utils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:03:27 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating existing volume attachment record: 6c1a6aa3-cb27-42cf-89f6-fbe7520d1750 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:03:29 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXsGJqgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:03:31 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:03:31 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:03:31 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[01011b9a-43f2-4f55-bd57-1ab151b3893f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:03:31 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3416b2-83f3-4eae-8ec2-7e6afa582056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3] added
Nov 14 04:03:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ff02ec-5d3e-4460-8bb9-6709b79d5474]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b5a220-56f9-4326-a9cd-ed340cea8364]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXsGJqgt {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mXsGJqgt" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05b4df-3585-4b00-bfeb-60c5404903dd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mXsGJqgt'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba7d825-e719-4f27-8154-f5826240edbd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c515f4-9067-4f02-9b19-312d8df8313e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:31 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:03:31 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0252d710-1dda-4cdc-a778-27f45de399c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260]
Nov 14 04:03:32 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260] successful.
Nov 14 04:03:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b096b4c-bb32-4cfe-bf47-d4c5f004251f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b486fb60-0712-431f-aaab-32a4cb5954db]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:32 user nova-compute[74836]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:32 user nova-compute[74836]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:32 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45683afa-f717-4d30-9692-3ad17a37db97]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXsGJqgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-changed-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Refreshing instance network info cache due to event network-changed-21febddc-2267-4598-b86c-34be59056657. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] Acquiring lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] Acquired lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG nova.network.neutron [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Refreshing network info cache for port 21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG nova.network.neutron [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updated VIF entry in instance network info cache for port 21febddc-2267-4598-b86c-34be59056657. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:03:32 user nova-compute[74836]: DEBUG nova.network.neutron [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating instance_info_cache with network_info: [{"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-5fdbdb55-95c1-4b68-a86f-f5206aa12a04 req-c63bb826-726c-43ea-881e-59a2883b022e service nova] Releasing lock "refresh_cache-d2cbd112-55bd-451a-843e-636481740b7a" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:33 user nova-compute[74836]: INFO nova.compute.manager [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Terminating instance
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23564303261373130', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564303261373130', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:03:33 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:03:33 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 04:03:33 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:03:33 user nova-compute[74836]:   <serial>c4fa78ec-7309-4db2-abbc-a8cee7cb09e3</serial>
Nov 14 04:03:33 user nova-compute[74836]: </disk>
Nov 14 04:03:33 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-unplugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] No waiting events found dispatching network-vif-unplugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.compute.manager [req-856314c2-ee15-40ec-b0b2-1bbc9e0608e4 req-042639c9-98c4-4c62-97b0-ec381b10e3b9 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-unplugged-21febddc-2267-4598-b86c-34be59056657 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No VIF found with MAC fa:16:3e:ff:30:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-9d6cc490-6139-403e-b238-40b38b172893 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.133s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:33 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Instance destroyed successfully.
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid d2cbd112-55bd-451a-843e-636481740b7a {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1577664153',display_name='tempest-TestVolumeBootPattern-server-1577664153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1577664153',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:01:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-v5m5hb7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:01:50Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=d2cbd112-55bd-451a-843e-636481740b7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "21febddc-2267-4598-b86c-34be59056657", "address": "fa:16:3e:62:73:f5", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21febddc-22", "ovs_interfaceid": "21febddc-2267-4598-b86c-34be59056657", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_vif [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21febddc-22, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d731c850-b977-4455-a0e4-0e16e57a3567) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:03:33 user nova-compute[74836]: INFO os_vif [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:73:f5,bridge_name='br-int',has_traffic_filtering=True,id=21febddc-2267-4598-b86c-34be59056657,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21febddc-22')
Nov 14 04:03:33 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:03:33 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e52439-3aac-45c1-a194-e9d984977037]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:03:33 user nova-compute[74836]: No targets found.
Nov 14 04:03:33 user nova-compute[74836]: iSNS:
Nov 14 04:03:33 user nova-compute[74836]: No targets found.
Nov 14 04:03:33 user nova-compute[74836]: STATIC:
Nov 14 04:03:33 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984
Nov 14 04:03:33 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:03:33 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:03:33 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3
Nov 14 04:03:33 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:03:33 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:03:33 user nova-compute[74836]: FIRMWARE:
Nov 14 04:03:33 user nova-compute[74836]: No targets found.
Nov 14 04:03:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:03:33 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:03:33 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe880c-a985-4be1-9c1e-5368c8c058ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[489619bc-9679-4dfc-a53a-0697a5de4f46]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:33 user nova-compute[74836]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:03:33 user nova-compute[74836]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:33 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d4472b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1255cde-ff71-442a-9b00-99f512188e2a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:33 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3331ca-cb4e-4b43-9376-a8c18024eacb]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd00193-1e11-4c0d-ae7a-3d678065d717]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afba55f-af7b-4404-af08-ec495816b27a]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3a0e6ac', '/dev/disk/by-id/scsi-1SCST_BIOd3a0e6ac-9c83072c7a6fe8a7', '/dev/disk/by-id/scsi-23963383330373263') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[13484ac0-a888-4d18-8aad-9d2ef80bd987]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9718b5-b158-4e64-8899-6e8a47f936d8]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4396fa-ebcf-48a5-9b4c-e8c2d261206e]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]
Nov 14 04:03:34 user nova-compute[74836]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.
Nov 14 04:03:34 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dae8e5b-33b2-4dc1-9b89-6498726a9235]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (300ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:03:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Deleting instance files /opt/stack/data/nova/instances/d2cbd112-55bd-451a-843e-636481740b7a_del
Nov 14 04:03:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Deletion of /opt/stack/data/nova/instances/d2cbd112-55bd-451a-843e-636481740b7a_del complete
Nov 14 04:03:34 user nova-compute[74836]: INFO nova.compute.manager [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 04:03:34 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:03:34 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:03:34 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Took 0.66 seconds to deallocate network for instance.
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] Acquiring lock "d2cbd112-55bd-451a-843e-636481740b7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] Lock "d2cbd112-55bd-451a-843e-636481740b7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] No waiting events found dispatching network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:03:35 user nova-compute[74836]: WARNING nova.compute.manager [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received unexpected event network-vif-plugged-21febddc-2267-4598-b86c-34be59056657 for instance with vm_state active and task_state deleting.
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.compute.manager [req-9a947987-e5b8-4b92-9eb0-726489d1cc22 req-bd932120-c564-43b4-9cb4-b2c1c5808fe4 service nova] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Received event network-vif-deleted-21febddc-2267-4598-b86c-34be59056657 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.objects.instance [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:35 user nova-compute[74836]: INFO nova.compute.manager [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: d2cbd112-55bd-451a-843e-636481740b7a] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:35 user nova-compute[74836]: INFO nova.compute.manager [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attaching volume 044532d8-c80f-46bf-9e77-9c2570fc526b to /dev/vdc
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.utils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a7dc43-5089-4101-901b-e36700523db8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab0c4d-93a7-4a9e-b749-9268c8396003]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe0bfc-55b8-4dba-bc15-a51a8410be92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5051ad30-68d9-4a69-be4f-bf6bf821f0ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:03:35 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:03:35 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4d6eb2-b514-4930-aa3e-40a1ce0c6336]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG os_brick.utils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:03:35 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating existing volume attachment record: 7e6f57bc-60e8-4003-a6e8-1359d35c071f {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:03:35 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance d2cbd112-55bd-451a-843e-636481740b7a
Nov 14 04:03:36 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-db54b542-6ad6-49fc-9f6b-449b177af3f9 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "d2cbd112-55bd-451a-843e-636481740b7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.948s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcyCudPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:03:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:03:39 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:03:39 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5763732-a9fa-4b25-8f0a-e0479d72082a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:03:39 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95daeb2-79ae-4959-9e4f-57a947df813e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b] added
Nov 14 04:03:39 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf68f9-33bc-4dee-b255-017009cbc06a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:39 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f50c7c-a682-4fdb-9a91-6abcee920143]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcyCudPF {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xcyCudPF" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd366700-a9d7-4d83-bddb-c19c73ceac7e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xcyCudPF'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8bb783-8f12-4508-a317-72309a71021b]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[77aeed2c-465c-46ff-a65e-0c1b934c08a5]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9aab07-0eed-4703-8bf9-91364703d35a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260]
Nov 14 04:03:40 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260] successful.
Nov 14 04:03:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[92052a8b-e0e8-413a-98b3-0192abed9625]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccdc85a-b5dc-4268-a0a6-8e75139a3310]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:40 user nova-compute[74836]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:03:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:03:40 user nova-compute[74836]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:03:40 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[beac5e58-a7df-41b7-bcc3-5657a3f40108]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:03:40 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcyCudPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23137336430666337', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137336430666337', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.objects.instance [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:03:41 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:03:41 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:03:41 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 04:03:41 user nova-compute[74836]:   <serial>044532d8-c80f-46bf-9e77-9c2570fc526b</serial>
Nov 14 04:03:41 user nova-compute[74836]: </disk>
Nov 14 04:03:41 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] No VIF found with MAC fa:16:3e:ff:30:d0, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:03:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-e926b9e9-829c-441d-873f-54e390251fb3 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.127s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:03:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:03:42 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:03:42 user nova-compute[74836]: INFO nova.compute.manager [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Detaching volume c4fa78ec-7309-4db2-abbc-a8cee7cb09e3
Nov 14 04:03:42 user nova-compute[74836]: INFO nova.virt.block_device [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attempting to driver detach volume c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 from mountpoint /dev/vdb
Nov 14 04:03:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Attempting to detach device vdb from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:03:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:03:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:03:42 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 04:03:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:03:42 user nova-compute[74836]:   <serial>c4fa78ec-7309-4db2-abbc-a8cee7cb09e3</serial>
Nov 14 04:03:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:03:42 user nova-compute[74836]: </disk>
Nov 14 04:03:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:03:42 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdb from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the persistent domain config.
Nov 14 04:03:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:03:42 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:03:42 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:03:42 user nova-compute[74836]:   <source dev="/dev/sdc"/>
Nov 14 04:03:42 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:03:42 user nova-compute[74836]:   <serial>c4fa78ec-7309-4db2-abbc-a8cee7cb09e3</serial>
Nov 14 04:03:42 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:03:42 user nova-compute[74836]: </disk>
Nov 14 04:03:42 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:03:43 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:03:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:03:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:03 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 is timed out.
Nov 14 04:04:03 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdb from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the live domain config.
Nov 14 04:04:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mXsGJqgt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:04:03 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39a15bd-31be-4e0e-b9db-ee1215d2e96e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:04:03 user nova-compute[74836]: No targets found.
Nov 14 04:04:03 user nova-compute[74836]: iSNS:
Nov 14 04:04:03 user nova-compute[74836]: No targets found.
Nov 14 04:04:03 user nova-compute[74836]: STATIC:
Nov 14 04:04:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b
Nov 14 04:04:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:04:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:04:03 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3
Nov 14 04:04:03 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:04:03 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:04:03 user nova-compute[74836]: FIRMWARE:
Nov 14 04:04:03 user nova-compute[74836]: No targets found.
Nov 14 04:04:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:04:03 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:04:03 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d6a649-c030-4cce-b8e6-fd67081e95b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea7ee30-2902-4f65-85a6-4ce391549c72]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:04:03 user nova-compute[74836]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:04:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 (non-flash)
Nov 14 04:04:03 user nova-compute[74836]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:04:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4512c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a732e99-a155-4102-9c17-6947b74bb953]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41dc9c-cd46-4178-a3fa-cada21cf391d]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c4ca03-1a3a-48a2-9f9d-ebfa1e58e1f2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3531df3a-edc4-401b-8048-550f3eab0c64]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a229a88c-e5c7-4109-b1b3-32ce2614e073]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50ccb02-11b5-45da-a493-6058f04a988c]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260]
Nov 14 04:04:03 user nova-compute[74836]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3, portal: 172.16.0.220,3260] successful.
Nov 14 04:04:03 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4fa78ec-7309-4db2-abbc-a8cee7cb09e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[117ddc33-e08a-436f-bc17-ed36f76c5168]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== disconnect_volume: return (295ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:04:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:04 user nova-compute[74836]: DEBUG nova.objects.instance [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:04:04 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-25c1c50d-e663-47bf-8256-f7dffa3c8c2c tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.557s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:05 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:05 user nova-compute[74836]: INFO nova.compute.manager [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Detaching volume 044532d8-c80f-46bf-9e77-9c2570fc526b
Nov 14 04:04:05 user nova-compute[74836]: INFO nova.virt.block_device [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Attempting to driver detach volume 044532d8-c80f-46bf-9e77-9c2570fc526b from mountpoint /dev/vdc
Nov 14 04:04:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Attempting to detach device vdc from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:04:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:04:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:04:05 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:04:05 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 04:04:05 user nova-compute[74836]:   <serial>044532d8-c80f-46bf-9e77-9c2570fc526b</serial>
Nov 14 04:04:05 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 04:04:05 user nova-compute[74836]: </disk>
Nov 14 04:04:05 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:04:05 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdc from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the persistent domain config.
Nov 14 04:04:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:04:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:04:05 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:04:05 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:04:05 user nova-compute[74836]:   <target dev="vdc" bus="virtio"/>
Nov 14 04:04:05 user nova-compute[74836]:   <serial>044532d8-c80f-46bf-9e77-9c2570fc526b</serial>
Nov 14 04:04:05 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 04:04:05 user nova-compute[74836]: </disk>
Nov 14 04:04:05 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:04:05 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:04:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:09 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:13 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:04:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:20 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:21 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:04:21 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:04:21 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9010MB free_disk=25.036685943603516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:04:21 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:04:22 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:04:22 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:04:22 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:04:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.206s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [{"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-1165987b-8a1c-48ed-9144-4dc8e73be1b5" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:04:24 user nova-compute[74836]: INFO nova.compute.claims [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Claim successful on node user
Nov 14 04:04:24 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:04:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.policy [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:04:25 user nova-compute[74836]: INFO nova.virt.block_device [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Booting with volume 49be29d2-470a-4d48-8f4c-81c1d2903984 at /dev/vda
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.utils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70f97a2-57d2-436e-8461-f9165107731d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d581ca15-1e23-4a7b-a80b-5b10d450585f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36170c0d-887d-4384-83be-d8076f5baa0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaa2925-ff3d-45fe-b8ed-05d52943ebb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:04:25 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed701c1-6340-47e0-98cb-713245ef20bc]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.utils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating existing volume attachment record: acfe2681-2513-45a7-b9a2-77efb5c10fb3 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Successfully created port: 22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:04:25 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 is timed out.
Nov 14 04:04:25 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully detached device vdc from instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5 from the live domain config.
Nov 14 04:04:25 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xcyCudPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:04:25 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5baf786-d532-4c51-a2e9-26b5547c65f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:04:25 user nova-compute[74836]: No targets found.
Nov 14 04:04:25 user nova-compute[74836]: iSNS:
Nov 14 04:04:25 user nova-compute[74836]: No targets found.
Nov 14 04:04:25 user nova-compute[74836]: STATIC:
Nov 14 04:04:25 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b
Nov 14 04:04:25 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:04:25 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:04:25 user nova-compute[74836]: FIRMWARE:
Nov 14 04:04:25 user nova-compute[74836]: No targets found.
Nov 14 04:04:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:04:25 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:04:25 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03c7115-174f-4bd1-bb08-ce2e06ad107c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b63bf7-a6a2-40a2-8f45-91974d8e9930]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:04:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b (non-flash)
Nov 14 04:04:25 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d42267a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[612050ec-6b53-4e21-b10e-873819ff0612]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:25 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1cc7e6-eaed-4a63-a8d5-7cc61486898f]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249165a-6601-4017-87aa-a3d69ccb2d25]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e99983-2625-4935-9ba0-2862ad7720c8]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f7f67-c037-42ed-b974-1f5916274e9f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[61898678-d28e-47a5-a988-e9ea1dc86054]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260]
Nov 14 04:04:26 user nova-compute[74836]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b, portal: 172.16.0.220,3260] successful.
Nov 14 04:04:26 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:044532d8-c80f-46bf-9e77-9c2570fc526b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1966904d-05d1-4a7e-9cf0-6fa9ca52e867]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] <== disconnect_volume: return (288ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Successfully updated port: 22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-changed-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.compute.manager [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing instance network info cache due to event network-changed-22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.network.neutron [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Instance network_info: |[{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.network.neutron [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing network info cache for port 22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:04:26 user nova-compute[74836]: DEBUG nova.objects.instance [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'flavor' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:04:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-bfea9162-1dfe-4f16-ad7c-fd2b5717d18d tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated VIF entry in instance network info cache for port 22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:04:27 user nova-compute[74836]: DEBUG nova.network.neutron [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:04:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-08fab815-3e19-4dac-a2ab-02a4075fec69 req-94ee76e9-6b4c-4b1a-9fdd-f20556ba030d service nova] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:28 user nova-compute[74836]: INFO nova.compute.manager [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Terminating instance
Nov 14 04:04:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-unplugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] No waiting events found dispatching network-vif-unplugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG nova.compute.manager [req-7d1b9256-3fb8-441f-98b8-95d7cc6df950 req-4afa8eed-bd0f-4bae-a64e-316ffeca6323 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-unplugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:04:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Instance destroyed successfully.
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lazy-loading 'resources' on Instance uuid 1165987b-8a1c-48ed-9144-4dc8e73be1b5 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:01:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-815731132',display_name='tempest-AttachVolumeTestJSON-server-815731132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-815731132',id=49,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbV2cf8dnmmkMp/hzSCXascK1Ok+I4hp/6VdxdiMr3rxDQdG+x5bJ706RA9Y7ir97QhGa6Frqk81Dq9fLre/0mnhyFXu7F1a/Ctm+tJYWO8+XjBuDyDX06cBf9u8ZJIEg==',key_name='tempest-keypair-1295019211',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:01:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='69d6ef35b32a4bfdb1763821cd7776c0',ramdisk_id='',reservation_id='r-b7mx4hdr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-152008285',owner_user_name='tempest-AttachVolumeTestJSON-152008285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='595bbdae7413457ebca1ac2c4c52fe50',uuid=1165987b-8a1c-48ed-9144-4dc8e73be1b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converting VIF {"id": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "address": "fa:16:3e:ff:30:d0", "network": {"id": "b3fcfcc2-417b-477b-822a-9f9861e279e1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-46675212-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "69d6ef35b32a4bfdb1763821cd7776c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85aec954-7c", "ovs_interfaceid": "85aec954-7c4c-4511-9cdf-a87df9d96bd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_vif [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85aec954-7c, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6094a0f1-2aa5-4eed-a061-fb44017ff17f) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:29 user nova-compute[74836]: INFO os_vif [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:30:d0,bridge_name='br-int',has_traffic_filtering=True,id=85aec954-7c4c-4511-9cdf-a87df9d96bd6,network=Network(b3fcfcc2-417b-477b-822a-9f9861e279e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85aec954-7c')
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Deleting instance files /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5_del
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Deletion of /opt/stack/data/nova/instances/1165987b-8a1c-48ed-9144-4dc8e73be1b5_del complete
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.compute.manager [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Creating image(s)
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Ensure instance console log exists: /opt/stack/data/nova/instances/4b6c1754-8396-404f-94f0-36914ab9d85d/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Start _get_guest_xml network_info=[{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b6c1754-8396-404f-94f0-36914ab9d85d', 'attached_at': '', 'detached_at': '', 'volume_id': '49be29d2-470a-4d48-8f4c-81c1d2903984', 'serial': '49be29d2-470a-4d48-8f4c-81c1d2903984'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': 'acfe2681-2513-45a7-b9a2-77efb5c10fb3', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:04:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:04:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:04:29 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:04:29 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:04:29 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8caf49-8dfa-49ac-aea6-4ad7b402b7f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:04:29 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b9c80-b0cb-4919-8dee-d17d064a3135]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984] added
Nov 14 04:04:29 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11edac1c-7ab0-4184-b775-2bc745f9e23f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9ec63-bad9-4858-80a8-f343e7aafde2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBaEWOpf {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBaEWOpf" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f9d532-1a05-4db6-a1c0-8afdad2f2d8d]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBaEWOpf'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d14a97-091b-4f58-9b11-85eab73fe1b3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b12a88-5169-465a-a3c3-fc27d671c5bd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:04:29 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:04:29 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:04:29 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:04:29 user nova-compute[74836]: 
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:04:29 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Took 0.74 seconds to deallocate network for instance.
Nov 14 04:04:29 user nova-compute[74836]: DEBUG nova.compute.manager [req-801471fa-4125-4848-889a-5955f4493e42 req-64312d10-b35a-46d5-ba56-5d49e0b56328 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-deleted-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3b00a4-0cb0-4f3e-95a6-e11f931c2d9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]
Nov 14 04:04:29 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.
Nov 14 04:04:29 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca99f3-8840-450c-aa6f-946179690cb2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac16702a-8fe3-449b-a457-6f5324154c3d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:04:29 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:04:29 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[53241103-1163-4f1e-acba-de6b4968c34c]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:04:29 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:30 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Deleted allocations for instance 1165987b-8a1c-48ed-9144-4dc8e73be1b5
Nov 14 04:04:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0dcb0d21-e8cc-4fca-b08e-a9a62d1d5c24 tempest-AttachVolumeTestJSON-152008285 tempest-AttachVolumeTestJSON-152008285-project-member] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.078s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] Acquiring lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] Lock "1165987b-8a1c-48ed-9144-4dc8e73be1b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] No waiting events found dispatching network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:04:30 user nova-compute[74836]: WARNING nova.compute.manager [req-57687e63-ae8e-47c3-85fc-80036ac9a7cf req-79be2160-b6a2-4952-9c6e-41bb5979c304 service nova] [instance: 1165987b-8a1c-48ed-9144-4dc8e73be1b5] Received unexpected event network-vif-plugged-85aec954-7c4c-4511-9cdf-a87df9d96bd6 for instance with vm_state deleted and task_state None.
Nov 14 04:04:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23963383330373263', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:04:30 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963383330373263', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1091618698',display_name='tempest-TestVolumeBootPattern-server-1091618698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1091618698',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-gzn54rb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:04:25Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=4b6c1754-8396-404f-94f0-36914ab9d85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:04:31 user nova-compute[74836]:   <uuid>4b6c1754-8396-404f-94f0-36914ab9d85d</uuid>
Nov 14 04:04:31 user nova-compute[74836]:   <name>instance-00000033</name>
Nov 14 04:04:31 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 04:04:31 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 04:04:31 user nova-compute[74836]:   <metadata>
Nov 14 04:04:31 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:04:31 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 04:04:31 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-server-1091618698</nova:name>
Nov 14 04:04:31 user nova-compute[74836]:       <nova:creationTime>2023-11-14 04:04:29</nova:creationTime>
Nov 14 04:04:31 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 04:04:31 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:04:31 user nova-compute[74836]:       </nova:flavor>
Nov 14 04:04:31 user nova-compute[74836]:       <nova:owner>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 04:04:31 user nova-compute[74836]:       </nova:owner>
Nov 14 04:04:31 user nova-compute[74836]:       <nova:ports>
Nov 14 04:04:31 user nova-compute[74836]:         <nova:port uuid="22a85815-c827-4974-97aa-14811a57a527">
Nov 14 04:04:31 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 04:04:31 user nova-compute[74836]:         </nova:port>
Nov 14 04:04:31 user nova-compute[74836]:       </nova:ports>
Nov 14 04:04:31 user nova-compute[74836]:     </nova:instance>
Nov 14 04:04:31 user nova-compute[74836]:   </metadata>
Nov 14 04:04:31 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 04:04:31 user nova-compute[74836]:     <system>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="serial">4b6c1754-8396-404f-94f0-36914ab9d85d</entry>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="uuid">4b6c1754-8396-404f-94f0-36914ab9d85d</entry>
Nov 14 04:04:31 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:04:31 user nova-compute[74836]:     </system>
Nov 14 04:04:31 user nova-compute[74836]:   </sysinfo>
Nov 14 04:04:31 user nova-compute[74836]:   <os>
Nov 14 04:04:31 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:04:31 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 04:04:31 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 04:04:31 user nova-compute[74836]:   </os>
Nov 14 04:04:31 user nova-compute[74836]:   <features>
Nov 14 04:04:31 user nova-compute[74836]:     <acpi/>
Nov 14 04:04:31 user nova-compute[74836]:     <apic/>
Nov 14 04:04:31 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 04:04:31 user nova-compute[74836]:   </features>
Nov 14 04:04:31 user nova-compute[74836]:   <clock offset="utc">
Nov 14 04:04:31 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:04:31 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:04:31 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 04:04:31 user nova-compute[74836]:   </clock>
Nov 14 04:04:31 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 04:04:31 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 04:04:31 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:04:31 user nova-compute[74836]:   </cpu>
Nov 14 04:04:31 user nova-compute[74836]:   <devices>
Nov 14 04:04:31 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 04:04:31 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:04:31 user nova-compute[74836]:       <source dev="/dev/sdb"/>
Nov 14 04:04:31 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 04:04:31 user nova-compute[74836]:       <serial>49be29d2-470a-4d48-8f4c-81c1d2903984</serial>
Nov 14 04:04:31 user nova-compute[74836]:     </disk>
Nov 14 04:04:31 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 04:04:31 user nova-compute[74836]:       <mac address="fa:16:3e:2c:84:b8"/>
Nov 14 04:04:31 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:04:31 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 04:04:31 user nova-compute[74836]:       <target dev="tap22a85815-c8"/>
Nov 14 04:04:31 user nova-compute[74836]:     </interface>
Nov 14 04:04:31 user nova-compute[74836]:     <serial type="pty">
Nov 14 04:04:31 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/4b6c1754-8396-404f-94f0-36914ab9d85d/console.log" append="off"/>
Nov 14 04:04:31 user nova-compute[74836]:     </serial>
Nov 14 04:04:31 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:04:31 user nova-compute[74836]:     <video>
Nov 14 04:04:31 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:04:31 user nova-compute[74836]:     </video>
Nov 14 04:04:31 user nova-compute[74836]:     <rng model="virtio">
Nov 14 04:04:31 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:04:31 user nova-compute[74836]:     </rng>
Nov 14 04:04:31 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:04:31 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 04:04:31 user nova-compute[74836]:       <stats period="10"/>
Nov 14 04:04:31 user nova-compute[74836]:     </memballoon>
Nov 14 04:04:31 user nova-compute[74836]:   </devices>
Nov 14 04:04:31 user nova-compute[74836]: </domain>
Nov 14 04:04:31 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1091618698',display_name='tempest-TestVolumeBootPattern-server-1091618698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1091618698',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-gzn54rb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:04:25Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=4b6c1754-8396-404f-94f0-36914ab9d85d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG os_vif [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9feed77-32c2-5660-b946-c55d8ad60fb3', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22a85815-c8, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22a85815-c8, col_values=(('qos', UUID('be542443-a4e3-4950-97ad-da06cda3f57e')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22a85815-c8, col_values=(('external_ids', {'iface-id': '22a85815-c827-4974-97aa-14811a57a527', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:84:b8', 'vm-uuid': '4b6c1754-8396-404f-94f0-36914ab9d85d'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:31 user nova-compute[74836]: INFO os_vif [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8')
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:04:31 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:2c:84:b8, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] No waiting events found dispatching network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:04:32 user nova-compute[74836]: WARNING nova.compute.manager [req-d4c11016-b72d-4ebc-9221-51cc220e62e0 req-56648bd6-aa7a-467d-8298-4c94744bdcf7 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received unexpected event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 for instance with vm_state building and task_state spawning.
Nov 14 04:04:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:32 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:04:34 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Instance spawned successfully.
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:04:34 user nova-compute[74836]: INFO nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:34 user nova-compute[74836]: DEBUG nova.compute.manager [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] No waiting events found dispatching network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:04:34 user nova-compute[74836]: WARNING nova.compute.manager [req-e0433f5a-0e79-4ff5-a1d0-ad62b12ffe2d req-de8f9bec-4a72-4215-bfee-a6ef309642b8 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received unexpected event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 for instance with vm_state building and task_state spawning.
Nov 14 04:04:34 user nova-compute[74836]: INFO nova.compute.manager [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Took 9.92 seconds to build instance.
Nov 14 04:04:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5b3a38ce-538f-4d32-8cf3-dc510121cec3 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.013s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:04:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:04:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:11 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:14 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:05:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:05:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:05:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:05:22 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:05:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:05:23 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.062381744384766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 4b6c1754-8396-404f-94f0-36914ab9d85d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:05:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:05:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:27 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:05:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:05:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:05:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:05:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:06:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-changed-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing instance network info cache due to event network-changed-22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing network info cache for port 22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated VIF entry in instance network info cache for port 22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.network.neutron [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-6aff8f72-ec11-4f85-ab37-eb09ada8c835 req-60ea1b39-7f27-48d7-a8a0-b9b0b412ce74 service nova] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:16 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:06:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:21 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:06:22 user nova-compute[74836]: INFO nova.compute.claims [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Claim successful on node user
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:06:22 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.policy [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb40ab0c80664eb5864a57683542943c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444ac9d071b74ccca3a0d7e0a5ce9dcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:06:22 user nova-compute[74836]: INFO nova.virt.block_device [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Booting with volume 5c6d2137-2a54-425b-a73b-65758ba4e046 at /dev/vda
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.utils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b06ca43-8035-4255-b73a-0ecd83fea6ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab1693b-e6a8-45a6-9e0e-1ac6edc8e28e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba94fc5-8124-488a-84fb-dae9bd788f2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[54974e59-57ac-4347-a036-adb8f7d9e72b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:06:22 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbdb1a4-561d-49b3-8e86-de4a958e913d]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG os_brick.utils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating existing volume attachment record: 33e9a402-3197-4662-8234-8685ac35d507 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:06:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Skipping network cache update for instance because it is Building. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Successfully created port: da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Successfully updated port: da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquired lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.compute.manager [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing instance network info cache due to event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] Acquiring lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:23 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:06:24 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:06:24 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.05038833618164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.network.neutron [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating instance_info_cache with network_info: [{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Releasing lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Instance network_info: |[{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] Acquired lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.network.neutron [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 4b6c1754-8396-404f-94f0-36914ab9d85d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance df5a5fee-1a26-4498-8b6e-45cfe6b2732f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:06:24 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updated VIF entry in instance network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:06:25 user nova-compute[74836]: DEBUG nova.network.neutron [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating instance_info_cache with network_info: [{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:06:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b3950b4e-aeb2-480e-8d0c-050ca31b92e5 req-3401f0bd-153e-4386-9519-7ffb50201f6e service nova] Releasing lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:06:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:06:27 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Creating image(s)
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Did not create local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Ensure instance console log exists: /opt/stack/data/nova/instances/df5a5fee-1a26-4498-8b6e-45cfe6b2732f/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Start _get_guest_xml network_info=[{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMfwjCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'df5a5fee-1a26-4498-8b6e-45cfe6b2732f', 'attached_at': '', 'detached_at': '', 'volume_id': '5c6d2137-2a54-425b-a73b-65758ba4e046', 'serial': '5c6d2137-2a54-425b-a73b-65758ba4e046'}, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'attachment_id': '33e9a402-3197-4662-8234-8685ac35d507', 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:06:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:06:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMfwjCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:06:27 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:06:27 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:06:27 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[114c478a-f576-4eef-9458-e4ec54b8b381]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:06:27 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da2c52-417d-4308-8f31-316e435b7c71]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046] added
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ac2f43-c9f8-4e28-8c49-ffa797105a22]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a208a9-f537-4f20-ad57-8587e01ab778]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etMfwjCX {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etMfwjCX" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c553d7-25e1-490a-9247-1cde9d7bb5bb]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etMfwjCX'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ddc2e-4cff-457d-8871-7ebbeb775884]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c35f4a6-81c2-4c39-afda-b5c49714227c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[80faa5cf-6d93-40fe-986d-f86542cb4232]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260]
Nov 14 04:06:27 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260] successful.
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[64191f10-f882-49af-9c82-c059993e6eef]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[58855517-7cd0-4076-bfe6-49bb50831758]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)
Nov 14 04:06:27 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a75843-d144-483f-94f2-5cc9604f11f3]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:06:27 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMfwjCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26338643061373464', 'path': '/dev/sdc'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338643061373464', 'path': '/dev/sdc'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-334318099',display_name='tempest-TestVolumeBootPattern-server-334318099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-334318099',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-y07eorxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:06:23Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=df5a5fee-1a26-4498-8b6e-45cfe6b2732f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.objects.instance [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'pci_devices' on Instance uuid df5a5fee-1a26-4498-8b6e-45cfe6b2732f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:06:28 user nova-compute[74836]:   <uuid>df5a5fee-1a26-4498-8b6e-45cfe6b2732f</uuid>
Nov 14 04:06:28 user nova-compute[74836]:   <name>instance-00000034</name>
Nov 14 04:06:28 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 04:06:28 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 04:06:28 user nova-compute[74836]:   <metadata>
Nov 14 04:06:28 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:06:28 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 04:06:28 user nova-compute[74836]:       <nova:name>tempest-TestVolumeBootPattern-server-334318099</nova:name>
Nov 14 04:06:28 user nova-compute[74836]:       <nova:creationTime>2023-11-14 04:06:27</nova:creationTime>
Nov 14 04:06:28 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 04:06:28 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:06:28 user nova-compute[74836]:       </nova:flavor>
Nov 14 04:06:28 user nova-compute[74836]:       <nova:owner>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:user uuid="bb40ab0c80664eb5864a57683542943c">tempest-TestVolumeBootPattern-1216379953-project-member</nova:user>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:project uuid="444ac9d071b74ccca3a0d7e0a5ce9dcd">tempest-TestVolumeBootPattern-1216379953</nova:project>
Nov 14 04:06:28 user nova-compute[74836]:       </nova:owner>
Nov 14 04:06:28 user nova-compute[74836]:       <nova:ports>
Nov 14 04:06:28 user nova-compute[74836]:         <nova:port uuid="da586f0c-a3c3-4410-a60b-e6a52752504e">
Nov 14 04:06:28 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 04:06:28 user nova-compute[74836]:         </nova:port>
Nov 14 04:06:28 user nova-compute[74836]:       </nova:ports>
Nov 14 04:06:28 user nova-compute[74836]:     </nova:instance>
Nov 14 04:06:28 user nova-compute[74836]:   </metadata>
Nov 14 04:06:28 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 04:06:28 user nova-compute[74836]:     <system>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="serial">df5a5fee-1a26-4498-8b6e-45cfe6b2732f</entry>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="uuid">df5a5fee-1a26-4498-8b6e-45cfe6b2732f</entry>
Nov 14 04:06:28 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:06:28 user nova-compute[74836]:     </system>
Nov 14 04:06:28 user nova-compute[74836]:   </sysinfo>
Nov 14 04:06:28 user nova-compute[74836]:   <os>
Nov 14 04:06:28 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:06:28 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 04:06:28 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 04:06:28 user nova-compute[74836]:   </os>
Nov 14 04:06:28 user nova-compute[74836]:   <features>
Nov 14 04:06:28 user nova-compute[74836]:     <acpi/>
Nov 14 04:06:28 user nova-compute[74836]:     <apic/>
Nov 14 04:06:28 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 04:06:28 user nova-compute[74836]:   </features>
Nov 14 04:06:28 user nova-compute[74836]:   <clock offset="utc">
Nov 14 04:06:28 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:06:28 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:06:28 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 04:06:28 user nova-compute[74836]:   </clock>
Nov 14 04:06:28 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 04:06:28 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 04:06:28 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:06:28 user nova-compute[74836]:   </cpu>
Nov 14 04:06:28 user nova-compute[74836]:   <devices>
Nov 14 04:06:28 user nova-compute[74836]:     <disk type="block" device="disk">
Nov 14 04:06:28 user nova-compute[74836]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:06:28 user nova-compute[74836]:       <source dev="/dev/sdc"/>
Nov 14 04:06:28 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 04:06:28 user nova-compute[74836]:       <serial>5c6d2137-2a54-425b-a73b-65758ba4e046</serial>
Nov 14 04:06:28 user nova-compute[74836]:     </disk>
Nov 14 04:06:28 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 04:06:28 user nova-compute[74836]:       <mac address="fa:16:3e:35:45:ba"/>
Nov 14 04:06:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:06:28 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 04:06:28 user nova-compute[74836]:       <target dev="tapda586f0c-a3"/>
Nov 14 04:06:28 user nova-compute[74836]:     </interface>
Nov 14 04:06:28 user nova-compute[74836]:     <serial type="pty">
Nov 14 04:06:28 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/df5a5fee-1a26-4498-8b6e-45cfe6b2732f/console.log" append="off"/>
Nov 14 04:06:28 user nova-compute[74836]:     </serial>
Nov 14 04:06:28 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:06:28 user nova-compute[74836]:     <video>
Nov 14 04:06:28 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:06:28 user nova-compute[74836]:     </video>
Nov 14 04:06:28 user nova-compute[74836]:     <rng model="virtio">
Nov 14 04:06:28 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:06:28 user nova-compute[74836]:     </rng>
Nov 14 04:06:28 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:06:28 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 04:06:28 user nova-compute[74836]:       <stats period="10"/>
Nov 14 04:06:28 user nova-compute[74836]:     </memballoon>
Nov 14 04:06:28 user nova-compute[74836]:   </devices>
Nov 14 04:06:28 user nova-compute[74836]: </domain>
Nov 14 04:06:28 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-334318099',display_name='tempest-TestVolumeBootPattern-server-334318099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-334318099',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-y07eorxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:06:23Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=df5a5fee-1a26-4498-8b6e-45cfe6b2732f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG os_vif [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499eaad7-d606-5eb4-a4f3-38f95ec9f0c3', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda586f0c-a3, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda586f0c-a3, col_values=(('qos', UUID('f6b2b924-d8ba-4301-9cb7-3669164ab2cc')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda586f0c-a3, col_values=(('external_ids', {'iface-id': 'da586f0c-a3c3-4410-a60b-e6a52752504e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:45:ba', 'vm-uuid': 'df5a5fee-1a26-4498-8b6e-45cfe6b2732f'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:28 user nova-compute[74836]: INFO os_vif [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3')
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:06:28 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] No VIF found with MAC fa:16:3e:35:45:ba, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:06:29 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:29 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:30 user nova-compute[74836]: DEBUG nova.compute.manager [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:06:30 user nova-compute[74836]: WARNING nova.compute.manager [req-d26efbb5-8b93-4665-b258-f8742d7416a1 req-79186dc8-a941-4215-9054-df19188f7c1f service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state building and task_state spawning.
Nov 14 04:06:31 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:06:32 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Instance spawned successfully.
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:06:32 user nova-compute[74836]: INFO nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:06:32 user nova-compute[74836]: INFO nova.compute.manager [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Took 10.18 seconds to build instance.
Nov 14 04:06:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-7e8c2767-f693-4542-957a-cbf07098cc9e tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.307s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:32 user nova-compute[74836]: DEBUG nova.compute.manager [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:06:32 user nova-compute[74836]: WARNING nova.compute.manager [req-46da47c8-afe3-4226-9f6b-ecaa614ef597 req-e3a333cb-fb18-4762-89da-f35b71632c46 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state active and task_state None.
Nov 14 04:06:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Verify base images {{(pid=74836) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74836) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] df5a5fee-1a26-4498-8b6e-45cfe6b2732f is a valid instance name {{(pid=74836) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] 4b6c1754-8396-404f-94f0-36914ab9d85d is a valid instance name {{(pid=74836) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221
Nov 14 04:06:37 user nova-compute[74836]: WARNING nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Unknown base file: /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Removable base files: /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5 /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3 /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9 /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941 /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85 /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145 /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221 /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f42ee1441edbf2c150c4c8df95ca735c8502ede5
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d3fa8473c88ae734ec70f1242174419227bc4c3
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eb91755240c8e4634aa99705c8dc3b20dd6ac0f9
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/60daa47ba7abbf3591cd9d667ecfeb236ff0d941
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/003a5010c3b21ba2f20c27573970241c310b21da
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3cd33a17db8699957a0ae0dcee794cff851d5d85
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/abee98cc3d056326eebcbb8e739030b430a42145
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b44dc02cd5c932de96ee5f4bc6bfe3aea45d221
Nov 14 04:06:37 user nova-compute[74836]: INFO nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04c184d03f457c2a70daabc12a124ca6470e857f
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Verification complete {{(pid=74836) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Verify swap images {{(pid=74836) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 04:06:37 user nova-compute[74836]: DEBUG nova.virt.libvirt.imagecache [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Verify ephemeral images {{(pid=74836) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:06:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:06:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:12 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:07:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:07:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:07:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:07:24 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:07:25 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:07:26 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:07:26 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=25.048847198486328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 4b6c1754-8396-404f-94f0-36914ab9d85d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance df5a5fee-1a26-4498-8b6e-45cfe6b2732f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:07:26 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:07:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:07:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:07:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:07:27 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:30 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:30 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:07:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Triggering sync for uuid df5a5fee-1a26-4498-8b6e-45cfe6b2732f {{(pid=74836) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:07:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:07:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:41 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:07:41 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:07:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:07:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:07:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG nova.compute.manager [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing instance network info cache due to event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] Acquiring lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] Acquired lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updated VIF entry in instance network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG nova.network.neutron [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating instance_info_cache with network_info: [{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-e21222d5-e761-4a2f-8679-d512b6016d08 req-9de0ea67-8a07-4c47-b0d0-18c0259b9bcb service nova] Releasing lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:08:14 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:15 user nova-compute[74836]: INFO nova.compute.manager [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Terminating instance
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing instance network info cache due to event network-changed-da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] Acquiring lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] Acquired lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Refreshing network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.compute.manager [req-7ac5e8b6-e06e-4364-a736-aa8b68cbffb8 req-4c5d940d-7e1c-408f-89af-ca516cc6bade service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updated VIF entry in instance network info cache for port da586f0c-a3c3-4410-a60b-e6a52752504e. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.network.neutron [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating instance_info_cache with network_info: [{"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-f3ca75e4-1b72-4b0a-8cb1-10459d830e7c req-7c5f1e56-7d58-4b52-b6fc-cc95088ec6fd service nova] Releasing lock "refresh_cache-df5a5fee-1a26-4498-8b6e-45cfe6b2732f" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Instance destroyed successfully.
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.objects.instance [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid df5a5fee-1a26-4498-8b6e-45cfe6b2732f {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:06:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-334318099',display_name='tempest-TestVolumeBootPattern-server-334318099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-334318099',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:06:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-y07eorxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:06:32Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=df5a5fee-1a26-4498-8b6e-45cfe6b2732f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "da586f0c-a3c3-4410-a60b-e6a52752504e", "address": "fa:16:3e:35:45:ba", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda586f0c-a3", "ovs_interfaceid": "da586f0c-a3c3-4410-a60b-e6a52752504e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_vif [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda586f0c-a3, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6b2b924-d8ba-4301-9cb7-3669164ab2cc) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:15 user nova-compute[74836]: INFO os_vif [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:45:ba,bridge_name='br-int',has_traffic_filtering=True,id=da586f0c-a3c3-4410-a60b-e6a52752504e,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda586f0c-a3')
Nov 14 04:08:15 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etMfwjCX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:08:15 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286ae74-c3d0-49c7-9728-bc027c5eb1c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:08:15 user nova-compute[74836]: No targets found.
Nov 14 04:08:15 user nova-compute[74836]: iSNS:
Nov 14 04:08:15 user nova-compute[74836]: No targets found.
Nov 14 04:08:15 user nova-compute[74836]: STATIC:
Nov 14 04:08:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984
Nov 14 04:08:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:08:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:08:15 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046
Nov 14 04:08:15 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:08:15 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:08:15 user nova-compute[74836]: FIRMWARE:
Nov 14 04:08:15 user nova-compute[74836]: No targets found.
Nov 14 04:08:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:08:15 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:08:15 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e5cac0-e1c9-48b2-ae9d-fd8587cb0d20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e33c4-d0ac-4e19-a31b-5d4dd9bf0c9e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:08:15 user nova-compute[74836]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)
Nov 14 04:08:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:08:15 user nova-compute[74836]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 (non-flash)
Nov 14 04:08:15 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e4210af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046'): ({'sdc'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdc {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c2ded-cf32-4e7c-b020-1d7be227948a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:15 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf011cfc-f295-4a85-9fcb-1d703801c9ae]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdc {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b6916d-bea3-4397-bb8b-986d3c3309a5]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf2a37-1cbc-4b63-964d-86fe3b8c3b74]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdc have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO17ab81ad-c8d0a74d6f892cef', '/dev/disk/by-id/scsi-26338643061373464', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_17ab81ad') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d080862-8a7a-4b05-852b-a53bbde6d184]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5838f8-3d36-42c9-9643-976392b9c549]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2f4ef9-227b-40a0-8176-55b07d091e62]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260]
Nov 14 04:08:16 user nova-compute[74836]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046, portal: 172.16.0.220,3260] successful.
Nov 14 04:08:16 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c6d2137-2a54-425b-a73b-65758ba4e046 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c8bbcd-37e9-4615-a8ac-1c1a2f0cacff]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (332ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:08:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Deleting instance files /opt/stack/data/nova/instances/df5a5fee-1a26-4498-8b6e-45cfe6b2732f_del
Nov 14 04:08:16 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Deletion of /opt/stack/data/nova/instances/df5a5fee-1a26-4498-8b6e-45cfe6b2732f_del complete
Nov 14 04:08:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:16 user nova-compute[74836]: INFO nova.compute.manager [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 04:08:16 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:16 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:08:16 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Took 0.46 seconds to deallocate network for instance.
Nov 14 04:08:16 user nova-compute[74836]: DEBUG nova.compute.manager [req-b60f336e-419e-46b6-a4e5-cafd235db574 req-911290e5-fe0f-4231-9002-76c41d65d98c service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-deleted-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:17 user nova-compute[74836]: WARNING nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state active and task_state deleting.
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:17 user nova-compute[74836]: WARNING nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state active and task_state deleting.
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:17 user nova-compute[74836]: WARNING nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state active and task_state deleting.
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-unplugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Acquiring lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] No waiting events found dispatching network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:08:17 user nova-compute[74836]: WARNING nova.compute.manager [req-186d4152-028f-4196-885e-b1d1995ec873 req-f48b7ea9-d07b-453d-bd63-fabbc778a7a8 service nova] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Received unexpected event network-vif-plugged-da586f0c-a3c3-4410-a60b-e6a52752504e for instance with vm_state active and task_state deleting.
Nov 14 04:08:17 user nova-compute[74836]: INFO nova.compute.manager [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: df5a5fee-1a26-4498-8b6e-45cfe6b2732f] Took 0.74 seconds to detach 1 volumes for instance.
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:17 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance df5a5fee-1a26-4498-8b6e-45cfe6b2732f
Nov 14 04:08:17 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-34385493-460f-4e66-9afb-b6bb688b2ead tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "df5a5fee-1a26-4498-8b6e-45cfe6b2732f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.796s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:18 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:08:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:08:25 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:26 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74836) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 04:08:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:08:27 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=25.040050506591797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 4b6c1754-8396-404f-94f0-36914ab9d85d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:08:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:08:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:32 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:08:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:08:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:09:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-changed-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG nova.compute.manager [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing instance network info cache due to event network-changed-22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] Acquiring lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] Acquired lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG nova.network.neutron [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Refreshing network info cache for port 22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:09 user nova-compute[74836]: INFO nova.compute.manager [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Terminating instance
Nov 14 04:09:09 user nova-compute[74836]: DEBUG nova.compute.manager [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:09 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-unplugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] No waiting events found dispatching network-vif-unplugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.compute.manager [req-60241d7b-c49c-4307-9173-16773a9e21a5 req-122237d7-e653-4d34-b214-08ce04e01eea service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-unplugged-22a85815-c827-4974-97aa-14811a57a527 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updated VIF entry in instance network info cache for port 22a85815-c827-4974-97aa-14811a57a527. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.network.neutron [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [{"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-10c66995-65a7-465e-aaa5-6275049e4763 req-84cd1011-d8b5-48dc-9598-eb07e5672566 service nova] Releasing lock "refresh_cache-4b6c1754-8396-404f-94f0-36914ab9d85d" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:09:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Instance destroyed successfully.
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.objects.instance [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lazy-loading 'resources' on Instance uuid 4b6c1754-8396-404f-94f0-36914ab9d85d {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:04:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1091618698',display_name='tempest-TestVolumeBootPattern-server-1091618698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1091618698',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOIPJCoUhwLMj7RrYTYrBonejAIhmyOvSnGYLz0MtKJG+JmRWplT6YgqZhPav7Uvlj7p4xOd5zwiX15wBBfXdgoirTFgNCfFEsRQBTAEo9zEJlDr5BPZcNAQ0BloxFMsA==',key_name='tempest-TestVolumeBootPattern-106894720',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:04:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='444ac9d071b74ccca3a0d7e0a5ce9dcd',ramdisk_id='',reservation_id='r-gzn54rb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1216379953',owner_user_name='tempest-TestVolumeBootPattern-1216379953-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:04:35Z,user_data=None,user_id='bb40ab0c80664eb5864a57683542943c',uuid=4b6c1754-8396-404f-94f0-36914ab9d85d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converting VIF {"id": "22a85815-c827-4974-97aa-14811a57a527", "address": "fa:16:3e:2c:84:b8", "network": {"id": "d49c1519-d810-47f4-98e3-73d2079075e7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1632469112-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "444ac9d071b74ccca3a0d7e0a5ce9dcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22a85815-c8", "ovs_interfaceid": "22a85815-c827-4974-97aa-14811a57a527", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_vif [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22a85815-c8, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be542443-a4e3-4950-97ad-da06cda3f57e) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:10 user nova-compute[74836]: INFO os_vif [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:84:b8,bridge_name='br-int',has_traffic_filtering=True,id=22a85815-c827-4974-97aa-14811a57a527,network=Network(d49c1519-d810-47f4-98e3-73d2079075e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22a85815-c8')
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBaEWOpf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:09:10 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29311e-cbeb-4dcc-bc20-2ec90e334dee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:09:10 user nova-compute[74836]: No targets found.
Nov 14 04:09:10 user nova-compute[74836]: iSNS:
Nov 14 04:09:10 user nova-compute[74836]: No targets found.
Nov 14 04:09:10 user nova-compute[74836]: STATIC:
Nov 14 04:09:10 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984
Nov 14 04:09:10 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:09:10 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:09:10 user nova-compute[74836]: FIRMWARE:
Nov 14 04:09:10 user nova-compute[74836]: No targets found.
Nov 14 04:09:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:09:10 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:09:10 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[05377895-ae62-4cf9-b9c7-89ea06e70e61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f143b03-524b-4638-8c84-c89002f68e2b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:09:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 (non-flash)
Nov 14 04:09:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d46c72e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e86d61-4b19-4891-9a67-d36f6e6414a9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[92953603-bb65-4fe0-ae4d-ff952b76a9c4]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf988f1a-5443-4ac6-b850-25278137ce54]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e945366-e88d-4a01-ac68-09291c854852]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d3a0e6ac', '/dev/disk/by-id/scsi-1SCST_BIOd3a0e6ac-9c83072c7a6fe8a7', '/dev/disk/by-id/scsi-23963383330373263') {{(pid=86110) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3935700-4c64-4649-a7e2-834df290d44b]: (4, None) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5abc1c-e0d0-41f0-ae94-690b59a25ffd]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f3a46d-bcb2-4dab-a269-8111464fc5dc]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260]
Nov 14 04:09:10 user nova-compute[74836]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984, portal: 172.16.0.220,3260] successful.
Nov 14 04:09:10 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49be29d2-470a-4d48-8f4c-81c1d2903984 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[279f7771-8941-40c3-8130-fdb3a7c6fd4a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] <== disconnect_volume: return (280ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:09:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Deleting instance files /opt/stack/data/nova/instances/4b6c1754-8396-404f-94f0-36914ab9d85d_del
Nov 14 04:09:10 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Deletion of /opt/stack/data/nova/instances/4b6c1754-8396-404f-94f0-36914ab9d85d_del complete
Nov 14 04:09:10 user nova-compute[74836]: INFO nova.compute.manager [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 04:09:10 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:09:10 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:09:11 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:09:11 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Took 0.44 seconds to deallocate network for instance.
Nov 14 04:09:12 user nova-compute[74836]: INFO nova.compute.manager [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] Acquiring lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] No waiting events found dispatching network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:09:12 user nova-compute[74836]: WARNING nova.compute.manager [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received unexpected event network-vif-plugged-22a85815-c827-4974-97aa-14811a57a527 for instance with vm_state deleted and task_state None.
Nov 14 04:09:12 user nova-compute[74836]: DEBUG nova.compute.manager [req-c3f4fc21-3819-44f7-baa4-7ad639133d95 req-6e0aa0cc-9561-42a6-b1a8-ec43cc3465fb service nova] [instance: 4b6c1754-8396-404f-94f0-36914ab9d85d] Received event network-vif-deleted-22a85815-c827-4974-97aa-14811a57a527 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:09:12 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Deleted allocations for instance 4b6c1754-8396-404f-94f0-36914ab9d85d
Nov 14 04:09:12 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-ebf65280-6566-4116-a54c-725ff6492f50 tempest-TestVolumeBootPattern-1216379953 tempest-TestVolumeBootPattern-1216379953-project-member] Lock "4b6c1754-8396-404f-94f0-36914ab9d85d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.588s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:15 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:20 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:09:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:09:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:09:26 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:09:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:27 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:27 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:27 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:09:28 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:09:28 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.039222717285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:09:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.135s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:09:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:09:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:09:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:09:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:10:06 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:19 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:10:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:28 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:10:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:10:29 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:10:29 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9220MB free_disk=25.037860870361328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:10:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:29 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:10:29 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:10:30 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:10:30 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:10:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:10:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:10:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:36 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:42 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:44 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Starting instance... {{(pid=74836) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74836) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 04:10:50 user nova-compute[74836]: INFO nova.compute.claims [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Claim successful on node user
Nov 14 04:10:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.248s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Start building networks asynchronously for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Allocating IP information in the background. {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] allocate_for_instance() {{(pid=74836) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 04:10:50 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 04:10:50 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Start building block device mappings for instance. {{(pid=74836) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.policy [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf50ff986cfa4b0889891aa1079970ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7110f3b88f584108b4b0016148460a2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74836) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Start spawning the instance on the hypervisor. {{(pid=74836) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Creating instance directory {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 04:10:51 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Creating image(s)
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "/opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "/opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "/opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.196s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk 1073741824 {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5,backing_fmt=raw /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk 1073741824" returned: 0 in 0.052s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "eb33d2a78792dcb71a21991d57c6193d7303f3d5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eb33d2a78792dcb71a21991d57c6193d7303f3d5 --force-share --output=json" returned: 0 in 0.223s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk. size=1073741824 {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Successfully created port: 0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.virt.disk.api [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Cannot resize image /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk to a smaller size. {{(pid=74836) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Created local disks {{(pid=74836) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Ensure instance console log exists: /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/console.log {{(pid=74836) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:51 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Successfully updated port: 0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Building network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-changed-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.compute.manager [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Refreshing instance network info cache due to event network-changed-0ded1b74-cee2-408a-b3b8-7d1b32212794. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Instance cache missing network info. {{(pid=74836) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.neutron [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Instance network_info: |[{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74836) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.neutron [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Refreshing network info cache for port 0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Start _get_guest_xml network_info=[{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encrypted': False, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encryption_options': None, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'size': 0, 'image_id': '430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 04:10:52 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:10:52 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CPU controller missing on host. {{(pid=74836) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.host [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CPU controller found on host. {{(pid=74836) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74836) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T03:26:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T03:27:06Z,direct_url=<?>,disk_format='qcow2',id=430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9d030b9781be43539094c9dc4294dac7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T03:27:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flavor limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Image limits 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flavor pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Image pref 0:0:0 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74836) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Got 1 possible topologies {{(pid=74836) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.hardware [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74836) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-468541956',display_name='tempest-SnapshotDataIntegrityTests-server-468541956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-468541956',id=53,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjhqIMyViKlsURMbpxTXjJiEbg6Cmc+BgDI6LEswuPjhR1fMJ6paD+bI3K2FVKvctjKAAPR/+aV6KXqTAA2tbl2JtgB8NyGjrRH8s18cpEsxvZVL70z6PDRHMG4blRx4g==',key_name='tempest-keypair-1568179453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7110f3b88f584108b4b0016148460a2d',ramdisk_id='',reservation_id='r-7bxzbjs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1125876925',owner_user_name='tempest-SnapshotDataIntegrityTests-1125876925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf50ff986cfa4b0889891aa1079970ef',uuid=7385531a-2628-4b44-9c04-804b2a3b0c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74836) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converting VIF {"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:10:52 user nova-compute[74836]: DEBUG nova.objects.instance [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'pci_devices' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] End _get_guest_xml xml=<domain type="kvm">
Nov 14 04:10:53 user nova-compute[74836]:   <uuid>7385531a-2628-4b44-9c04-804b2a3b0c48</uuid>
Nov 14 04:10:53 user nova-compute[74836]:   <name>instance-00000035</name>
Nov 14 04:10:53 user nova-compute[74836]:   <memory>524288</memory>
Nov 14 04:10:53 user nova-compute[74836]:   <vcpu>1</vcpu>
Nov 14 04:10:53 user nova-compute[74836]:   <metadata>
Nov 14 04:10:53 user nova-compute[74836]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 04:10:53 user nova-compute[74836]:       <nova:package version="0.0.0"/>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-468541956</nova:name>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:creationTime>2023-11-14 04:10:52</nova:creationTime>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:flavor name="m1.tiny">
Nov 14 04:10:53 user nova-compute[74836]:         <nova:memory>512</nova:memory>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:disk>1</nova:disk>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:swap>0</nova:swap>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:vcpus>1</nova:vcpus>
Nov 14 04:10:53 user nova-compute[74836]:       </nova:flavor>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:owner>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:user uuid="bf50ff986cfa4b0889891aa1079970ef">tempest-SnapshotDataIntegrityTests-1125876925-project-member</nova:user>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:project uuid="7110f3b88f584108b4b0016148460a2d">tempest-SnapshotDataIntegrityTests-1125876925</nova:project>
Nov 14 04:10:53 user nova-compute[74836]:       </nova:owner>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:root type="image" uuid="430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5"/>
Nov 14 04:10:53 user nova-compute[74836]:       <nova:ports>
Nov 14 04:10:53 user nova-compute[74836]:         <nova:port uuid="0ded1b74-cee2-408a-b3b8-7d1b32212794">
Nov 14 04:10:53 user nova-compute[74836]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 04:10:53 user nova-compute[74836]:         </nova:port>
Nov 14 04:10:53 user nova-compute[74836]:       </nova:ports>
Nov 14 04:10:53 user nova-compute[74836]:     </nova:instance>
Nov 14 04:10:53 user nova-compute[74836]:   </metadata>
Nov 14 04:10:53 user nova-compute[74836]:   <sysinfo type="smbios">
Nov 14 04:10:53 user nova-compute[74836]:     <system>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="product">OpenStack Nova</entry>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="version">0.0.0</entry>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="serial">7385531a-2628-4b44-9c04-804b2a3b0c48</entry>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="uuid">7385531a-2628-4b44-9c04-804b2a3b0c48</entry>
Nov 14 04:10:53 user nova-compute[74836]:       <entry name="family">Virtual Machine</entry>
Nov 14 04:10:53 user nova-compute[74836]:     </system>
Nov 14 04:10:53 user nova-compute[74836]:   </sysinfo>
Nov 14 04:10:53 user nova-compute[74836]:   <os>
Nov 14 04:10:53 user nova-compute[74836]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 04:10:53 user nova-compute[74836]:     <boot dev="hd"/>
Nov 14 04:10:53 user nova-compute[74836]:     <smbios mode="sysinfo"/>
Nov 14 04:10:53 user nova-compute[74836]:   </os>
Nov 14 04:10:53 user nova-compute[74836]:   <features>
Nov 14 04:10:53 user nova-compute[74836]:     <acpi/>
Nov 14 04:10:53 user nova-compute[74836]:     <apic/>
Nov 14 04:10:53 user nova-compute[74836]:     <vmcoreinfo/>
Nov 14 04:10:53 user nova-compute[74836]:   </features>
Nov 14 04:10:53 user nova-compute[74836]:   <clock offset="utc">
Nov 14 04:10:53 user nova-compute[74836]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 04:10:53 user nova-compute[74836]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 04:10:53 user nova-compute[74836]:     <timer name="hpet" present="no"/>
Nov 14 04:10:53 user nova-compute[74836]:   </clock>
Nov 14 04:10:53 user nova-compute[74836]:   <cpu mode="custom" match="exact">
Nov 14 04:10:53 user nova-compute[74836]:     <model>Nehalem</model>
Nov 14 04:10:53 user nova-compute[74836]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 04:10:53 user nova-compute[74836]:   </cpu>
Nov 14 04:10:53 user nova-compute[74836]:   <devices>
Nov 14 04:10:53 user nova-compute[74836]:     <disk type="file" device="disk">
Nov 14 04:10:53 user nova-compute[74836]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 04:10:53 user nova-compute[74836]:       <source file="/opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk"/>
Nov 14 04:10:53 user nova-compute[74836]:       <target dev="vda" bus="virtio"/>
Nov 14 04:10:53 user nova-compute[74836]:     </disk>
Nov 14 04:10:53 user nova-compute[74836]:     <interface type="ethernet">
Nov 14 04:10:53 user nova-compute[74836]:       <mac address="fa:16:3e:f6:7d:45"/>
Nov 14 04:10:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:10:53 user nova-compute[74836]:       <mtu size="1442"/>
Nov 14 04:10:53 user nova-compute[74836]:       <target dev="tap0ded1b74-ce"/>
Nov 14 04:10:53 user nova-compute[74836]:     </interface>
Nov 14 04:10:53 user nova-compute[74836]:     <serial type="pty">
Nov 14 04:10:53 user nova-compute[74836]:       <log file="/opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/console.log" append="off"/>
Nov 14 04:10:53 user nova-compute[74836]:     </serial>
Nov 14 04:10:53 user nova-compute[74836]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 04:10:53 user nova-compute[74836]:     <video>
Nov 14 04:10:53 user nova-compute[74836]:       <model type="virtio"/>
Nov 14 04:10:53 user nova-compute[74836]:     </video>
Nov 14 04:10:53 user nova-compute[74836]:     <rng model="virtio">
Nov 14 04:10:53 user nova-compute[74836]:       <backend model="random">/dev/urandom</backend>
Nov 14 04:10:53 user nova-compute[74836]:     </rng>
Nov 14 04:10:53 user nova-compute[74836]:     <controller type="usb" index="0" model="none"/>
Nov 14 04:10:53 user nova-compute[74836]:     <memballoon model="virtio">
Nov 14 04:10:53 user nova-compute[74836]:       <stats period="10"/>
Nov 14 04:10:53 user nova-compute[74836]:     </memballoon>
Nov 14 04:10:53 user nova-compute[74836]:   </devices>
Nov 14 04:10:53 user nova-compute[74836]: </domain>
Nov 14 04:10:53 user nova-compute[74836]:  {{(pid=74836) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-468541956',display_name='tempest-SnapshotDataIntegrityTests-server-468541956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-468541956',id=53,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjhqIMyViKlsURMbpxTXjJiEbg6Cmc+BgDI6LEswuPjhR1fMJ6paD+bI3K2FVKvctjKAAPR/+aV6KXqTAA2tbl2JtgB8NyGjrRH8s18cpEsxvZVL70z6PDRHMG4blRx4g==',key_name='tempest-keypair-1568179453',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7110f3b88f584108b4b0016148460a2d',ramdisk_id='',reservation_id='r-7bxzbjs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1125876925',owner_user_name='tempest-SnapshotDataIntegrityTests-1125876925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T04:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf50ff986cfa4b0889891aa1079970ef',uuid=7385531a-2628-4b44-9c04-804b2a3b0c48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converting VIF {"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG os_vif [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce') {{(pid=74836) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5914bc0e-355f-52ea-b397-fb453fcac59c', '_type': 'linux-noop'}}, row=False) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ded1b74-ce, may_exist=True, interface_attrs={}) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ded1b74-ce, col_values=(('qos', UUID('f7f8d259-151a-47e0-83c5-6a00c87ecbbe')),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ded1b74-ce, col_values=(('external_ids', {'iface-id': '0ded1b74-cee2-408a-b3b8-7d1b32212794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:7d:45', 'vm-uuid': '7385531a-2628-4b44-9c04-804b2a3b0c48'}),), if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:53 user nova-compute[74836]: INFO os_vif [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce')
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No VIF found with MAC fa:16:3e:f6:7d:45, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated VIF entry in instance network info cache for port 0ded1b74-cee2-408a-b3b8-7d1b32212794. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG nova.network.neutron [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:10:53 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-bd38c7da-7b2f-487e-821c-296995a9672e req-761256bf-b74b-4170-80e5-25fa7032dab9 service nova] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:10:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:54 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG nova.compute.manager [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] No waiting events found dispatching network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:10:55 user nova-compute[74836]: WARNING nova.compute.manager [req-b4508d83-337d-4352-91cb-4df3fb7afedf req-b19b2d63-4ebd-4020-b94c-8d7a7b625fb1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received unexpected event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 for instance with vm_state building and task_state spawning.
Nov 14 04:10:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Instance event wait completed in 0 seconds for  {{(pid=74836) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Guest created on hypervisor {{(pid=74836) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 04:10:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Instance spawned successfully.
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_cdrom_bus of ide {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_disk_bus of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_input_bus of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_pointer_model of None {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_video_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Found default for hw_vif_model of virtio {{(pid=74836) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.compute.manager [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] No waiting events found dispatching network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:10:57 user nova-compute[74836]: WARNING nova.compute.manager [req-afa49693-19de-47cd-a23f-98c6f27aac11 req-81c2863e-d846-476e-93fc-7804966768a2 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received unexpected event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 for instance with vm_state building and task_state spawning.
Nov 14 04:10:57 user nova-compute[74836]: INFO nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 14 04:10:57 user nova-compute[74836]: DEBUG nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Checking state {{(pid=74836) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 04:10:57 user nova-compute[74836]: INFO nova.compute.manager [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Took 6.77 seconds to build instance.
Nov 14 04:10:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-eaf4bf3d-25d1-4ff1-bd92-7e6b43545cbf tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.928s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:10:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:04 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:11 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:16 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:21 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:11:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:26 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:27 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:11:28 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:11:29 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:11:30 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:11:30 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=24.993938446044922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:11:30 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:11:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:11:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:11:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:11:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:12:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:17 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:12:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:12:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:23 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:12:23 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:12:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:28 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:30 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:12:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:12:31 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:12:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:12:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.993385314941406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:12:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-changed-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG nova.compute.manager [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Refreshing instance network info cache due to event network-changed-0ded1b74-cee2-408a-b3b8-7d1b32212794. {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Refreshing network info cache for port 0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated VIF entry in instance network info cache for port 0ded1b74-cee2-408a-b3b8-7d1b32212794. {{(pid=74836) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG nova.network.neutron [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:12:41 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-9da82ed8-2a2e-4d5a-880a-1b9720c9d2a8 req-69f278d0-f0be-4a3d-ae5c-c59839fd6e6f service nova] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:12:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:12:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:12:43 user nova-compute[74836]: DEBUG nova.objects.instance [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:12:43 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:12:44 user nova-compute[74836]: INFO nova.compute.manager [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attaching volume cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f to /dev/vdb
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.utils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d351ec9-68a5-4d47-b2f5-9c19efab77b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6063e9cc-6be6-45dd-af08-f28ab949672f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ade91a-14cd-4f10-a70b-cbb3996baf02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222d075-15eb-440d-a4b0-cd56635bd75c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:12:44 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:12:44 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[154429b5-13d0-48ad-920d-3bf5a8204803]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG os_brick.utils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:12:44 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating existing volume attachment record: 22721ee0-dd58-4e97-802b-7393a6f080cf {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:12:46 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsCWzYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:12:48 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:12:48 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:12:48 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3dd143-ab38-4bba-a664-3fbbbd94e915]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:12:48 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc63e8-4911-49c7-b355-5de4eebb4e1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f] added
Nov 14 04:12:48 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b10ae1d-3a15-44be-ba79-dcf2e59c83ef]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb84b381-5306-44c2-815d-403c544214db]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsCWzYUX {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsCWzYUX" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b7f0c-19b3-493d-b621-fd868881c61c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsCWzYUX'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c22704-fd9d-470e-83ef-7ba9c38250c7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced35e1f-13fd-4f41-8d0c-3038257d4379]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:12:48 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:12:48 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:12:48 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:12:48 user nova-compute[74836]: 
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f54dd2-d362-48da-83ea-010bc29e8d3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260]
Nov 14 04:12:48 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260] successful.
Nov 14 04:12:48 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdc501b-9a3b-46fb-b0ab-61309989fe65]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d8f60-f470-42b2-88d7-58f85908bdbd]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)
Nov 14 04:12:48 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)
Nov 14 04:12:48 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5871e31b-491b-49f6-b1f4-7423d5155e2d]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:12:48 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsCWzYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:12:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:12:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23863393362666632', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:12:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863393362666632', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:12:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:12:49 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:12:49 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:12:49 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:12:49 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:12:49 user nova-compute[74836]:   <serial>cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f</serial>
Nov 14 04:12:49 user nova-compute[74836]: </disk>
Nov 14 04:12:49 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:12:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:12:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:12:50 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No VIF found with MAC fa:16:3e:f6:7d:45, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:12:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-57bdb70f-287a-4191-bf33-464a869dca67 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.099s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:12:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:52 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:12:52 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:12:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:12:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:12:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:12:57 user nova-compute[74836]: INFO nova.compute.manager [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Detaching volume cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f
Nov 14 04:12:57 user nova-compute[74836]: INFO nova.virt.block_device [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attempting to driver detach volume cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f from mountpoint /dev/vdb
Nov 14 04:12:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Attempting to detach device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:12:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:12:57 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:12:57 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:12:57 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:12:57 user nova-compute[74836]:   <serial>cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f</serial>
Nov 14 04:12:57 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:12:57 user nova-compute[74836]: </disk>
Nov 14 04:12:57 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:12:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config.
Nov 14 04:12:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:12:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:12:57 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:12:57 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:12:57 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:12:57 user nova-compute[74836]:   <serial>cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f</serial>
Nov 14 04:12:57 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:12:57 user nova-compute[74836]: </disk>
Nov 14 04:12:57 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:12:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:12:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:16 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:17 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 is timed out.
Nov 14 04:13:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config.
Nov 14 04:13:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsCWzYUX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:13:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbdc27d-1bbb-44d6-9608-e34db38ee406]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:13:18 user nova-compute[74836]: No targets found.
Nov 14 04:13:18 user nova-compute[74836]: iSNS:
Nov 14 04:13:18 user nova-compute[74836]: No targets found.
Nov 14 04:13:18 user nova-compute[74836]: STATIC:
Nov 14 04:13:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f
Nov 14 04:13:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:13:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:13:18 user nova-compute[74836]: FIRMWARE:
Nov 14 04:13:18 user nova-compute[74836]: No targets found.
Nov 14 04:13:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:13:18 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:13:18 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf6587b-fd8a-4035-b5ed-c70528372152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da53b7a-2f46-446f-8e61-793f9e4f66bd]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)
Nov 14 04:13:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f (non-flash)
Nov 14 04:13:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43bbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5422eef-435f-4b22-9c8b-a4dd173d85db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9831ba1-017e-4171-8564-a63a68ba90c7]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa6d61-c1b1-4a2c-a9c5-35fbee5701ab]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3560e0a7-60ad-45f8-9f8a-3191659e72bc]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31a63f-7d33-4f76-aafb-0a3c6d04d089]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a904e423-fcfe-41de-b477-a2024e0c50cb]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260]
Nov 14 04:13:18 user nova-compute[74836]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f, portal: 172.16.0.220,3260] successful.
Nov 14 04:13:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc4b7e7b-0cd1-4f95-bb7a-b99ac468d48f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[886610b8-7fbc-4a26-a535-d2e4ec1db55e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== disconnect_volume: return (257ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:13:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:13:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-5aed2cfa-687a-49f8-b08c-165ccdee7754 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.668s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:13:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:13:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:13:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:30 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:13:30 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:13:31 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:13:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:13:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.99215316772461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:13:32 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:13:33 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:13:33 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:13:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:13:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:39 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:13:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:13:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:13:49 user nova-compute[74836]: INFO nova.compute.manager [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attaching volume c3557182-8826-4dac-9af5-e7f8af781f9e to /dev/vdb
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.utils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[324aaaeb-35bc-4144-a330-dbbfbe9c9fef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dc9a1a-3136-47b5-a995-9f6728cf9d52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[36511dca-4df3-46d1-b642-fed50159c77e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b050b-c56b-4d6f-b3ef-bb1bcd272bd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:13:49 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:13:49 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df7800c-f78c-4e03-adaa-600f62e65a3f]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG os_brick.utils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:13:49 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating existing volume attachment record: 34d3a0b1-4ae7-484d-ac43-692adde5c404 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:13:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYKPbrfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:13:53 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:13:53 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:13:53 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1f7188-01b8-42e5-b389-d82f56dec878]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:13:53 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[55971500-ec73-43ce-8e09-30bbb838022b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e] added
Nov 14 04:13:53 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1548fc27-cabe-4174-971b-9906f1683f56]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a2ea5-eb92-4bc8-989e-a8bf6d222158]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:53 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYKPbrfk {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pYKPbrfk" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e036f953-6819-413d-a2b8-df762a5e0778]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pYKPbrfk'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0e7282-e6f8-41dc-841f-106018f1da3a]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c035c4-1a31-49e8-ac7b-60922efe5089]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:13:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:13:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:13:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:13:54 user nova-compute[74836]: 
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215fc1c-86bf-4f57-9a30-731635825f8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260]
Nov 14 04:13:54 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260] successful.
Nov 14 04:13:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f31d36a-913d-4bbe-b753-c2508ec0b772]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[420f5c57-4afc-4d65-a91c-ddd2252fe1b3]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)
Nov 14 04:13:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)
Nov 14 04:13:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4b9632-6ef2-45dd-8437-3b70069c7937]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:13:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYKPbrfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26537336134613938', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537336134613938', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:13:55 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:13:55 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:13:55 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:13:55 user nova-compute[74836]:   <serial>c3557182-8826-4dac-9af5-e7f8af781f9e</serial>
Nov 14 04:13:55 user nova-compute[74836]: </disk>
Nov 14 04:13:55 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No VIF found with MAC fa:16:3e:f6:7d:45, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:13:55 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-76fa9ba4-f394-4e54-8886-4497e52b2118 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.083s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:13:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:13:57 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:13:57 user nova-compute[74836]: INFO nova.compute.manager [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Detaching volume c3557182-8826-4dac-9af5-e7f8af781f9e
Nov 14 04:13:57 user nova-compute[74836]: INFO nova.virt.block_device [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attempting to driver detach volume c3557182-8826-4dac-9af5-e7f8af781f9e from mountpoint /dev/vdb
Nov 14 04:13:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Attempting to detach device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:13:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:13:57 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:13:57 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:13:57 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:13:57 user nova-compute[74836]:   <serial>c3557182-8826-4dac-9af5-e7f8af781f9e</serial>
Nov 14 04:13:57 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:13:57 user nova-compute[74836]: </disk>
Nov 14 04:13:57 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:13:57 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config.
Nov 14 04:13:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:13:57 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:13:57 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:13:57 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:13:57 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:13:57 user nova-compute[74836]:   <serial>c3557182-8826-4dac-9af5-e7f8af781f9e</serial>
Nov 14 04:13:57 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:13:57 user nova-compute[74836]: </disk>
Nov 14 04:13:57 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:13:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:13:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:14:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 is timed out.
Nov 14 04:14:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config.
Nov 14 04:14:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pYKPbrfk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:14:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e6ddc-355f-4ff0-8bb3-133d5adfb709]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:14:18 user nova-compute[74836]: No targets found.
Nov 14 04:14:18 user nova-compute[74836]: iSNS:
Nov 14 04:14:18 user nova-compute[74836]: No targets found.
Nov 14 04:14:18 user nova-compute[74836]: STATIC:
Nov 14 04:14:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e
Nov 14 04:14:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:14:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:14:18 user nova-compute[74836]: FIRMWARE:
Nov 14 04:14:18 user nova-compute[74836]: No targets found.
Nov 14 04:14:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:14:18 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:14:18 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[875e0312-2660-4443-9cea-3e98fd028cd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[be86bc0b-aea4-4554-9875-dcda7811a8c1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)
Nov 14 04:14:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e (non-flash)
Nov 14 04:14:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d40fedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a78d4a-9eb1-4b8f-a00b-3849255e6229]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f57157-2ef4-406f-a029-a157a9a7a214]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aa4670-6977-4096-9044-961f23bea5f4]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863c7fa-59e2-4d82-86b9-1b4127176849]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1070c1f8-1922-4db4-9f61-c454d056edd3]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5a7b58-6922-4b66-8c8d-28bdfc81d8be]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260]
Nov 14 04:14:18 user nova-compute[74836]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e, portal: 172.16.0.220,3260] successful.
Nov 14 04:14:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3557182-8826-4dac-9af5-e7f8af781f9e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4ca67e-e9b9-408c-89dc-ae73fd322744]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== disconnect_volume: return (328ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:14:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:14:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-a64f0bfd-c759-4b19-8dcf-026451a5107b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.636s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:14:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:21 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:14:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:24 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:14:31 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:14:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=24.991207122802734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:14:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:14:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:14:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:14:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:14:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:14:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:14:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:14:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:14:49 user nova-compute[74836]: DEBUG nova.objects.instance [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:14:49 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:14:50 user nova-compute[74836]: INFO nova.compute.manager [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attaching volume 40497698-a469-487b-b808-9891870993fa to /dev/vdb
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3180826-d802-4966-b700-6bdb286b67f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[873bcd84-42ac-4f5f-b219-0e510f9361f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8537a822-688f-45f0-ab6f-19774d7e6edf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4c84a7-c48c-4165-8d51-8effa65a5ce8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:14:50 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:14:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f20ab-0576-422c-b3b5-1345993f5546]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:14:50 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating existing volume attachment record: 389e91e0-d46a-4978-b967-4427dee49626 {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:14:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOgdCXGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:14:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:14:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:14:54 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363f1df-bde7-45b6-b869-b78c053304e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:14:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d10982c-661b-401b-9a58-fa58c2a6e432]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa] added
Nov 14 04:14:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[582348ea-b11f-4710-bca1-fbc9efcb9af2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48ff5e9-7c9c-4d6a-9ca0-15085ee31bca]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOgdCXGk {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QOgdCXGk" returned: 0 in 0.026s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1033a6-20f4-4852-92e6-344a7c591970]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QOgdCXGk'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[908eac36-1611-4a5a-a305-98bfa7f3690f]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[381cc0e2-4e08-474e-92e2-a9c11327e24d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:14:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:14:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:14:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:14:54 user nova-compute[74836]: 
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bca7c2-35e2-4be5-b245-38df7ed8439d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260]
Nov 14 04:14:54 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260] successful.
Nov 14 04:14:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e9b81c-ed59-4fc0-8095-21512a85d302]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[840597d6-c952-4a4c-8e07-d796f62698d1]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)
Nov 14 04:14:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)
Nov 14 04:14:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e385c-6904-43fe-baa2-5453246361fe]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:14:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOgdCXGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:14:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:14:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26561653038383866', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:14:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561653038383866', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:14:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:14:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:14:55 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:14:55 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:14:55 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:14:55 user nova-compute[74836]:   <serial>40497698-a469-487b-b808-9891870993fa</serial>
Nov 14 04:14:55 user nova-compute[74836]: </disk>
Nov 14 04:14:55 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:14:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:14:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:14:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No VIF found with MAC fa:16:3e:f6:7d:45, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:14:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-acea9f1e-f369-449f-b470-a4b30b247819 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.117s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:14:56 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:14:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:14:58 user nova-compute[74836]: INFO nova.compute.manager [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Detaching volume 40497698-a469-487b-b808-9891870993fa
Nov 14 04:14:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:14:58 user nova-compute[74836]: INFO nova.virt.block_device [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attempting to driver detach volume 40497698-a469-487b-b808-9891870993fa from mountpoint /dev/vdb
Nov 14 04:14:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Attempting to detach device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:14:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:14:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:14:58 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:14:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:14:58 user nova-compute[74836]:   <serial>40497698-a469-487b-b808-9891870993fa</serial>
Nov 14 04:14:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:14:58 user nova-compute[74836]: </disk>
Nov 14 04:14:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:14:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config.
Nov 14 04:14:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:14:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:14:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:14:58 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:14:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:14:58 user nova-compute[74836]:   <serial>40497698-a469-487b-b808-9891870993fa</serial>
Nov 14 04:14:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:14:58 user nova-compute[74836]: </disk>
Nov 14 04:14:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:14:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:15:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:18 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 is timed out.
Nov 14 04:15:18 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config.
Nov 14 04:15:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QOgdCXGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:15:18 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a111d27-9f56-43ee-8c61-a3a49143ae2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:15:18 user nova-compute[74836]: No targets found.
Nov 14 04:15:18 user nova-compute[74836]: iSNS:
Nov 14 04:15:18 user nova-compute[74836]: No targets found.
Nov 14 04:15:18 user nova-compute[74836]: STATIC:
Nov 14 04:15:18 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa
Nov 14 04:15:18 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:15:18 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:15:18 user nova-compute[74836]: FIRMWARE:
Nov 14 04:15:18 user nova-compute[74836]: No targets found.
Nov 14 04:15:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:15:18 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:15:18 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c000995-fb9e-4c0e-8e7d-4a54f6bf2a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b55887-e7d8-4533-a531-e81a3696b29b]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)
Nov 14 04:15:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa (non-flash)
Nov 14 04:15:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29e43ba8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fe0198-449d-4277-9157-360658ab652f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2999010-aa5a-4e43-923a-c4bb9e80168e]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d02dc1b-f79e-4145-a600-87c09f46e6a0]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db31be7-2f32-4e09-a3ff-61c61f547773]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac7420f-61ba-43ce-8fb8-62d16b54cba9]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537c2e8-a64e-4970-96c5-be33111fc604]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260]
Nov 14 04:15:18 user nova-compute[74836]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa, portal: 172.16.0.220,3260] successful.
Nov 14 04:15:18 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40497698-a469-487b-b808-9891870993fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[323fbf1a-aef0-4521-8f97-f1c8b81d2a4e]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== disconnect_volume: return (278ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:15:18 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:15:19 user nova-compute[74836]: DEBUG nova.objects.instance [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:15:19 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-2298d5d9-400c-4f3b-8758-04d2f78875aa tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.550s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:15:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:15:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:15:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:15:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:15:31 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:15:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9036MB free_disk=24.99020004272461GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:15:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:15:33 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:15:34 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:15:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:15:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:15:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:15:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:42 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:15:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:15:50 user nova-compute[74836]: INFO nova.compute.manager [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attaching volume 3903d312-eed1-42c7-9ee7-d1119ef2d081 to /dev/vdb
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e72455-8942-4158-9f8b-372c0fc5782c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50bf1f7dcab2\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[a384ce4c-d45d-4c61-94ac-2a2385996a5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3645f8c-6277-48ac-965d-1404c89837e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9460e7-0ea2-4b3e-8044-e9fffaadf6bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Running cmd (subprocess): nvme version {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] nvme not present on system {{(pid=74836) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 04:15:50 user nova-compute[74836]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 04:15:50 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[07810d96-7a94-480a-9909-ed5ffc89bd37]: (4, '') {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74836) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.lightos [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] LIGHTOS: no hostnqn found. {{(pid=74836) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG os_brick.utils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50bf1f7dcab2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:15:50 user nova-compute[74836]: DEBUG nova.virt.block_device [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating existing volume attachment record: 94097aaf-c002-41d9-a32c-61f50739759d {{(pid=74836) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 04:15:51 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Calling os-brick to attach iSCSI Volume {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXDFfxQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:15:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:15:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:15:54 user nova-compute[74836]: INFO os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c130e488-c650-4d8f-95d7-7723f7b2989f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 04:15:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --interface default --op new {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b618c1cb-f200-4f09-85e5-5ea699e47385]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081] added\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081] added
Nov 14 04:15:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f46bd4-ae6e-4c60-afd8-9fa33622bf37]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8c017b-6bd5-439f-a4ad-5ac91b5cbde2]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXDFfxQS {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXDFfxQS" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[11acbd23-bdfb-4ded-8cf5-1c2f087dcf53]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXDFfxQS'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[4833daf2-2105-4525-b81a-e688c68e77aa]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade9eb2-a4f3-40bd-ab79-203713fe4f90]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:15:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 04:15:54 user nova-compute[74836]:  {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:15:54 user nova-compute[74836]: WARNING os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 04:15:54 user nova-compute[74836]: 
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --login {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9294c45-854d-474a-a842-738c691808b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260]
Nov 14 04:15:54 user nova-compute[74836]: Login to [iface: default, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260] successful.
Nov 14 04:15:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[879fa97f-850d-456b-b5ac-8ad7e3034fc7]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2a500f-69c5-4514-a404-0505d50884ad]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)
Nov 14 04:15:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)
Nov 14 04:15:54 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to 172.16.0.220:3260 {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=74836) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74836) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca676ec8-b569-4955-ab4f-accd8e53d1a0]: (4, ('- - 0', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:15:54 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74836) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXDFfxQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74836) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '26639383035393030', 'path': '/dev/sdb'} {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639383035393030', 'path': '/dev/sdb'} {{(pid=74836) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 04:15:55 user nova-compute[74836]: DEBUG nova.objects.instance [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:15:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 04:15:56 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:15:56 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:15:56 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:15:56 user nova-compute[74836]:   <serial>3903d312-eed1-42c7-9ee7-d1119ef2d081</serial>
Nov 14 04:15:56 user nova-compute[74836]: </disk>
Nov 14 04:15:56 user nova-compute[74836]:  {{(pid=74836) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 04:15:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vda, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:15:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74836) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 04:15:56 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] No VIF found with MAC fa:16:3e:f6:7d:45, not building metadata {{(pid=74836) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 04:15:56 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-0482b738-cdcf-4fba-a40f-e4e863f2aa50 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.085s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:15:58 user nova-compute[74836]: INFO nova.compute.manager [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Detaching volume 3903d312-eed1-42c7-9ee7-d1119ef2d081
Nov 14 04:15:58 user nova-compute[74836]: INFO nova.virt.block_device [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Attempting to driver detach volume 3903d312-eed1-42c7-9ee7-d1119ef2d081 from mountpoint /dev/vdb
Nov 14 04:15:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Attempting to detach device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config. {{(pid=74836) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:15:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:15:58 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:15:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:15:58 user nova-compute[74836]:   <serial>3903d312-eed1-42c7-9ee7-d1119ef2d081</serial>
Nov 14 04:15:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:15:58 user nova-compute[74836]: </disk>
Nov 14 04:15:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:15:58 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the persistent domain config.
Nov 14 04:15:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config. {{(pid=74836) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 04:15:58 user nova-compute[74836]: DEBUG nova.virt.libvirt.guest [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 04:15:58 user nova-compute[74836]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 04:15:58 user nova-compute[74836]:   <source dev="/dev/sdb"/>
Nov 14 04:15:58 user nova-compute[74836]:   <target dev="vdb" bus="virtio"/>
Nov 14 04:15:58 user nova-compute[74836]:   <serial>3903d312-eed1-42c7-9ee7-d1119ef2d081</serial>
Nov 14 04:15:58 user nova-compute[74836]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 04:15:58 user nova-compute[74836]: </disk>
Nov 14 04:15:58 user nova-compute[74836]:  {{(pid=74836) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 04:15:59 user nova-compute[74836]: DEBUG nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 04:16:01 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:03 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:08 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:13 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:18 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:19 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 is timed out.
Nov 14 04:16:19 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully detached device vdb from instance 7385531a-2628-4b44-9c04-804b2a3b0c48 from the live domain config.
Nov 14 04:16:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] calling os-brick to detach iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f29e43c4190>, {'target_iqn': 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXDFfxQS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 04:16:19 user nova-compute[74836]: WARNING os_brick.initiator.connectors.base [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[429b0d12-9c5e-45ee-8f7d-e662f7e2edfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 04:16:19 user nova-compute[74836]: No targets found.
Nov 14 04:16:19 user nova-compute[74836]: iSNS:
Nov 14 04:16:19 user nova-compute[74836]: No targets found.
Nov 14 04:16:19 user nova-compute[74836]: STATIC:
Nov 14 04:16:19 user nova-compute[74836]: Target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081
Nov 14 04:16:19 user nova-compute[74836]:         Portal: 172.16.0.220:3260,-1
Nov 14 04:16:19 user nova-compute[74836]:                 Iface Name: default
Nov 14 04:16:19 user nova-compute[74836]: FIRMWARE:
Nov 14 04:16:19 user nova-compute[74836]: No targets found.
Nov 14 04:16:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 04:16:19 user nova-compute[74836]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 04:16:19 user nova-compute[74836]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74836) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081', 0)] {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e903f7f-be77-45b7-a954-aa5e93d83d4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e35ab4d-be21-4b83-9c42-56ae20a8f0f6]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)
Nov 14 04:16:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 (non-flash)
Nov 14 04:16:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f29d44bcaf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081'): ({'sdb'}, set())}) {{(pid=74836) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Removing single pathed devices sdb {{(pid=74836) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bf1cca-6b80-4257-86b1-ae6f04013282]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad40478-445e-4d56-9106-946beb6d55e8]: (4, ('ok\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Flushing IO for device /dev/sdb {{(pid=74836) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04461bd-8118-4067-b252-5daa8dcd2f10]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74836) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9929b4-ddfd-4aae-8bb4-9139967279c0]: (4, ('1', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.linuxscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] SCSI volumes sdb have been removed. {{(pid=74836) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081')] {{(pid=74836) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[590637dc-2e45-4aea-89d8-f3df23f6fa9c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --logout {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[07276977-2c1c-4f4d-8868-f1a871278d6a]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260]
Nov 14 04:16:19 user nova-compute[74836]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081, portal: 172.16.0.220,3260] successful.
Nov 14 04:16:19 user nova-compute[74836]:  stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op delete {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3903d312-eed1-42c7-9ee7-d1119ef2d081 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86110) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG oslo.privsep.daemon [-] privsep: reply[140094ff-c7b8-4dad-9321-31f7d041079c]: (4, ('', '')) {{(pid=86110) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74836) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.base [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG os_brick.initiator.connectors.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] <== disconnect_volume: return (274ms) None {{(pid=74836) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 04:16:19 user nova-compute[74836]: DEBUG nova.virt.libvirt.volume.iscsi [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Disconnected iSCSI Volume {{(pid=74836) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 04:16:20 user nova-compute[74836]: DEBUG nova.objects.instance [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'flavor' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:16:20 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-371b484e-e870-4cbc-a242-437d82a6abc4 tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.556s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:16:20 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:16:23 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:25 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:28 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:31 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:16:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:16:31 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:16:31 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.processutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74836) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 04:16:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:16:32 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.9892578125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Instance 7385531a-2628-4b44-9c04-804b2a3b0c48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74836) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:16:32 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:16:33 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:16:34 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:16:34 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquired lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Forcefully refreshing network info cache for instance {{(pid=74836) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG nova.objects.instance [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lazy-loading 'info_cache' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG nova.network.neutron [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [{"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Releasing lock "refresh_cache-7385531a-2628-4b44-9c04-804b2a3b0c48" {{(pid=74836) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updated the network info_cache for instance {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:35 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:38 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:16:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:16:43 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:48 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:16:58 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:16:59 user nova-compute[74836]: INFO nova.compute.manager [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Terminating instance
Nov 14 04:16:59 user nova-compute[74836]: DEBUG nova.compute.manager [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Start destroying the instance on the hypervisor. {{(pid=74836) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-unplugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] No waiting events found dispatching network-vif-unplugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:16:59 user nova-compute[74836]: DEBUG nova.compute.manager [req-d34e987b-a223-4634-91d2-17e4b2521ef2 req-5ddca154-a244-47ea-bcc0-a2f2eaa16aa1 service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-unplugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 for instance with task_state deleting. {{(pid=74836) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Instance destroyed successfully.
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.objects.instance [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lazy-loading 'resources' on Instance uuid 7385531a-2628-4b44-9c04-804b2a3b0c48 {{(pid=74836) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.virt.libvirt.vif [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T04:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-468541956',display_name='tempest-SnapshotDataIntegrityTests-server-468541956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-468541956',id=53,image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMjhqIMyViKlsURMbpxTXjJiEbg6Cmc+BgDI6LEswuPjhR1fMJ6paD+bI3K2FVKvctjKAAPR/+aV6KXqTAA2tbl2JtgB8NyGjrRH8s18cpEsxvZVL70z6PDRHMG4blRx4g==',key_name='tempest-keypair-1568179453',keypairs=<?>,launch_index=0,launched_at=2023-11-14T04:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7110f3b88f584108b4b0016148460a2d',ramdisk_id='',reservation_id='r-7bxzbjs8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='430a04e5-324a-4a57-9fc5-d6f3a7c6bbb5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1125876925',owner_user_name='tempest-SnapshotDataIntegrityTests-1125876925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T04:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf50ff986cfa4b0889891aa1079970ef',uuid=7385531a-2628-4b44-9c04-804b2a3b0c48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converting VIF {"id": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "address": "fa:16:3e:f6:7d:45", "network": {"id": "98c4ce66-a5b5-42d8-b19b-9ea82123ebc1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1958544383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7110f3b88f584108b4b0016148460a2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ded1b74-ce", "ovs_interfaceid": "0ded1b74-cee2-408a-b3b8-7d1b32212794", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.network.os_vif_util [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce') {{(pid=74836) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG os_vif [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce') {{(pid=74836) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ded1b74-ce, bridge=br-int, if_exists=True) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7f8d259-151a-47e0-83c5-6a00c87ecbbe) {{(pid=74836) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:00 user nova-compute[74836]: INFO os_vif [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:7d:45,bridge_name='br-int',has_traffic_filtering=True,id=0ded1b74-cee2-408a-b3b8-7d1b32212794,network=Network(98c4ce66-a5b5-42d8-b19b-9ea82123ebc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ded1b74-ce')
Nov 14 04:17:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Deleting instance files /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48_del
Nov 14 04:17:00 user nova-compute[74836]: INFO nova.virt.libvirt.driver [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Deletion of /opt/stack/data/nova/instances/7385531a-2628-4b44-9c04-804b2a3b0c48_del complete
Nov 14 04:17:00 user nova-compute[74836]: INFO nova.compute.manager [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 04:17:00 user nova-compute[74836]: DEBUG oslo.service.loopingcall [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74836) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.compute.manager [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Deallocating network for instance {{(pid=74836) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 04:17:00 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] deallocate_for_instance() {{(pid=74836) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.network.neutron [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Updating instance_info_cache with network_info: [] {{(pid=74836) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 04:17:01 user nova-compute[74836]: INFO nova.compute.manager [-] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Took 0.62 seconds to deallocate network for instance.
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-608aa30f-b798-4ff4-a58a-7bf13cca07c7 req-172214b2-2b61-433f-8b2f-f0ee5337680a service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-deleted-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:17:01 user nova-compute[74836]: INFO nova.scheduler.client.report [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Deleted allocations for instance 7385531a-2628-4b44-9c04-804b2a3b0c48
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-756b5ed6-3790-4010-b4a9-8a0456bee92b tempest-SnapshotDataIntegrityTests-1125876925 tempest-SnapshotDataIntegrityTests-1125876925-project-member] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] Acquiring lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] Lock "7385531a-2628-4b44-9c04-804b2a3b0c48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:17:01 user nova-compute[74836]: DEBUG nova.compute.manager [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] No waiting events found dispatching network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 {{(pid=74836) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 04:17:01 user nova-compute[74836]: WARNING nova.compute.manager [req-c9a9ce2c-1961-499d-85d1-305734b13d31 req-2f02a80d-e29c-49bf-910f-ad4610e96c3d service nova] [instance: 7385531a-2628-4b44-9c04-804b2a3b0c48] Received unexpected event network-vif-plugged-0ded1b74-cee2-408a-b3b8-7d1b32212794 for instance with vm_state deleted and task_state None.
Nov 14 04:17:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74836) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74836) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 04:17:20 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:21 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:22 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:22 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74836) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 04:17:25 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:26 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:27 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:30 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:32 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 04:17:32 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] There are 0 instances to clean {{(pid=74836) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Starting heal instance info cache {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Rebuilding the list of instances to heal {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Didn't find any instances for network info cache update. {{(pid=74836) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager.update_available_resource {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:17:33 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Auditing locally available compute resources for user (node: user) {{(pid=74836) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 04:17:34 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:17:34 user nova-compute[74836]: WARNING nova.virt.libvirt.driver [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=25.01641082763672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74836) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74836) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing inventories for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating ProviderTree inventory for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Updating inventory in ProviderTree for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing aggregate associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, aggregates: None {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Refreshing trait associations for resource provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de, traits: COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_ACCELERATORS,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_RTL8139 {{(pid=74836) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.provider_tree [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed in ProviderTree for provider: 9f482475-a4db-44a1-b0c2-dcf4a6aba2de {{(pid=74836) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.scheduler.client.report [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Inventory has not changed for provider 9f482475-a4db-44a1-b0c2-dcf4a6aba2de based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74836) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG nova.compute.resource_tracker [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Compute_service record updated for user:user {{(pid=74836) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 04:17:34 user nova-compute[74836]: DEBUG oslo_concurrency.lockutils [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74836) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 04:17:35 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:36 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:36 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:37 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:38 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:40 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:45 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:46 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:17:50 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:53 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:54 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:17:54 user nova-compute[74836]: DEBUG nova.compute.manager [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Cleaning up deleted instances with incomplete migration  {{(pid=74836) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 04:17:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:55 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:17:57 user nova-compute[74836]: DEBUG oslo_service.periodic_task [None req-91dc809d-de3c-4b0a-b9ef-069a879b472d None None] Running periodic task ComputeManager._sync_power_states {{(pid=74836) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 04:18:00 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:18:05 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 04:18:10 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 04:18:15 user nova-compute[74836]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=74836) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}